Validator Collection¶
Python library of 60+ commonly-used validator functions
Branch | Unit Tests |
---|---|
latest | |
v. 1.0.0 | |
develop |
Validator Reference¶
Core | Date/Time | Numbers | File-related | Internet-related |
---|---|---|---|---|
dict |
date |
numeric |
bytesIO |
email |
string |
datetime |
integer |
stringIO |
url |
iterable |
time |
float |
path |
ip_address |
none |
timezone |
fraction |
path_exists |
ipv4 |
not_empty |
decimal |
file_exists |
ipv6 |
|
uuid |
directory_exists |
mac_address |
||
variable_name |
Core¶
dict¶
-
dict
(value, allow_empty=False, json_serializer=None)[source]¶ Validate that
value
is adict
.Hint
If
value
is a string, this validator will assume it is a JSON object and try to convert it into adict
You can override the JSON serializer used by passing it to the
json_serializer
property. By default, will utilize the Pythonjson
encoder/decoder.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
. - json_serializer (callable) – The JSON encoder/decoder to use to deserialize a
string passed in
value
. If not supplied, will default to the Pythonjson
encoder/decoder.
Returns: value
/None
Return type: dict
/None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- ValueError – if
value
is not adict
string¶
-
string
(value, allow_empty=False, coerce_value=False, minimum_length=None, maximum_length=None, whitespace_padding=False)[source]¶ Validate that
value
is a valid string.Parameters: - value (
str
/None
) – The value to validate. - allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
. - coerce_value (
bool
) – IfTrue
, will attempt to coercevalue
to a string if it is not already. IfFalse
, will raise aValueError
ifvalue
is not a string. Defaults toFalse
. - minimum_length (
int
) – If supplied, indicates the minimum number of characters needed to be valid. - maximum_length (
int
) – If supplied, indicates the minimum number of characters needed to be valid. - whitespace_padding (
bool
) – IfTrue
and the value is below theminimum_length
, pad the value with spaces. Defaults toFalse
.
Returns: value
/None
Return type: str
/None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- ValueError – if
value
is not a valid string andcoerce_value
isFalse
- ValueError – if
minimum_length
is supplied and the length ofvalue
is less thanminimum_length
andwhitespace_padding
isFalse
- ValueError – if
maximum_length
is supplied and the length ofvalue
is more than themaximum_length
- value (
iterable¶
-
iterable
(value, allow_empty=False, forbid_literals=(<class 'str'>, <class 'bytes'>), minimum_length=None, maximum_length=None)[source]¶ Validate that
value
is a valid iterable.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
. - forbid_literals (iterable) – A collection of literals that will be considered invalid
even if they are (actually) iterable. Defaults to
str
andbytes
. - minimum_length (
int
) – If supplied, indicates the minimum number of members needed to be valid. - maximum_length (
int
) – If supplied, indicates the minimum number of members needed to be valid.
Returns: value
/None
Return type: iterable /
None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- ValueError – if
value
is not a valid iterable orNone
- ValueError – if
minimum_length
is supplied and the length ofvalue
is less thanminimum_length
andwhitespace_padding
isFalse
- ValueError – if
maximum_length
is supplied and the length ofvalue
is more than themaximum_length
none¶
-
none
(value, allow_empty=False)[source]¶ Validate that
value
isNone
.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty but notNone
. IfFalse
, raises aValueError
ifvalue
is empty but notNone
. Defaults toFalse
.
Returns: None
Raises: ValueError – if
allow_empty
isFalse
andvalue
is empty but notNone
and
not_empty¶
-
not_empty
(value, allow_empty=False)[source]¶ Validate that
value
is not empty.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
.
Returns: value
/None
Raises: ValueError – if
value
is empty andallow_empty
isFalse
uuid¶
-
uuid
(value, allow_empty=False)[source]¶ Validate that
value
is a validUUID
.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
.
Returns: value
coerced to aUUID
object /None
Return type: UUID
/None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- TypeError – if
value
cannot be coerced to aUUID
variable_name¶
-
variable_name
(value, allow_empty=False)[source]¶ Validate that the value is a valid Python variable name.
Caution
This function does NOT check whether the variable exists. It only checks that the
value
would work as a Python variable (or class, or function, etc.) name.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
.
Returns: value
/None
Return type: str
orNone
Raises: ValueError – if
allow_empty
isFalse
andvalue
is empty
Date / Time¶
date¶
-
date
(value, allow_empty=False, minimum=None, maximum=None)[source]¶ Validate that
value
is a valid date.Parameters: - value (
str
/datetime
/date
/None
) – The value to validate. - allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
. - minimum (
datetime
/date
/ compliantstr
/None
) – If supplied, will make sure thatvalue
is on or after this value. - maximum (
datetime
/date
/ compliantstr
/None
) – If supplied, will make sure thatvalue
is on or before this value.
Returns: value
/None
Return type: date
/None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- ValueError – if
value
is not a valid value type orNone
- ValueError – if
minimum
is supplied butvalue
occurs beforeminimum
- ValueError – if
maximum
is supplied butvalue
occurs afterminimum
- value (
datetime¶
-
datetime
(value, allow_empty=False, minimum=None, maximum=None)[source]¶ Validate that
value
is a valid datetime.Caution
If supplying a string, the string needs to be in an ISO 8601-format to pass validation. If it is not in an ISO 8601-format, validation will fail.
Parameters: - value (
str
/datetime
/date
/None
) – The value to validate. - allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
. - minimum (
datetime
/date
/ compliantstr
/None
) – If supplied, will make sure thatvalue
is on or after this value. - maximum (
datetime
/date
/ compliantstr
/None
) – If supplied, will make sure thatvalue
is on or before this value.
Returns: value
/None
Return type: datetime
/None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- ValueError – if
minimum
is supplied butvalue
occurs beforeminimum
- ValueError – if
maximum
is supplied butvalue
occurs afterminimum
- value (
time¶
-
time
(value, allow_empty=False, minimum=None, maximum=None)[source]¶ Validate that
value
is a validtime
.Caution
This validator will always return the time as timezone naive (effectively UTC). If
value
has a timezone / UTC offset applied, the validator will coerce the value returned back to UTC.Parameters: - value (
datetime
ortime
-compliantstr
/datetime
/time
) – The value to validate. - allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
. - minimum (
datetime
ortime
-compliantstr
/datetime
/time
) – If supplied, will make sure thatvalue
is on or after this value. - maximum (
datetime
ortime
-compliantstr
/datetime
/time
) – If supplied, will make sure thatvalue
is on or before this value.
Returns: value
in UTC time /None
Return type: time
/None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- ValueError – if
value
is not a valid value type orNone
- ValueError – if
minimum
is supplied butvalue
occurs beforeminimum
- ValueError – if
maximum
is supplied butvalue
occurs afterminimum
- value (
timezone¶
-
timezone
(value, allow_empty=False, positive=True)[source]¶ Validate that
value
is a validtzinfo
.Caution
This does not validate whether the value is a timezone that actually exists, nor can it resolve timzone names (e.g.
'Eastern'
or'CET'
).For that kind of functionality, we recommend you utilize: pytz
Parameters: - value (
str
/tzinfo
/ numeric /None
) – The value to validate. - allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
is empty. IfFalse
, raises aValueError
ifvalue
is empty. Defaults toFalse
. - positive (
bool
) – Indicates whether thevalue
is positive or negative (only has meaning ifvalue
is a string). Defaults toTrue
.
Returns: value
/None
Return type: tzinfo
/None
Raises: - ValueError – if
value
is empty andallow_empty
isFalse
- ValueError – if
value
is not a valid value type orNone
- value (
Numbers¶
Note
Because Python’s None
is implemented as an integer
value, numeric validators do not check “falsiness”. Doing so would find
false positives if value
were set to 0
.
Instead, all numeric validators explicitly check for the Python global singleton
None
.
numeric¶
-
numeric
(value, allow_empty=False, minimum=None, maximum=None)[source]¶ Validate that
value
is a numeric value.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
isNone
. IfFalse
, raises aValueError
ifvalue
isNone
. Defaults toFalse
. - minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value.
Returns: value
/None
Raises: - ValueError – if
value
isNone
andallow_empty
isFalse
- ValueError – if
minimum
is supplied andvalue
is less than theminimum
- ValueError – if
maximum
is supplied andvalue
is more than themaximum
integer¶
-
integer
(value, allow_empty=False, coerce_value=False, minimum=None, maximum=None, base=10)[source]¶ Validate that
value
is anint
.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
isNone
. IfFalse
, raises aValueError
ifvalue
isNone
. Defaults toFalse
. - coerce_value (
bool
) – IfTrue
, will force any numericvalue
to an integer (always rounding up). IfFalse
, will raise an error ifvalue
is numeric but not a whole number. Defaults toFalse
. - minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value. - base – Indicates the base that is used to determine the integer value.
The allowed values are 0 and 2–36. Base-2, -8, and -16 literals can be
optionally prefixed with
0b/0B
,0o/0O/0
, or0x/0X
, as with integer literals in code. Base 0 means to interpret the string exactly as an integer literal, so that the actual base is 2, 8, 10, or 16. Defaults to10
.
Returns: value
/None
Raises: - ValueError – if
value
isNone
andallow_empty
isFalse
- ValueError – if
minimum
is supplied andvalue
is less than theminimum
- ValueError – if
maximum
is supplied andvalue
is more than themaximum
float¶
-
float
(value, allow_empty=False, minimum=None, maximum=None)[source]¶ Validate that
value
is afloat
.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
isNone
. IfFalse
, raises aValueError
ifvalue
isNone
. Defaults toFalse
.
Returns: value
/None
Return type: float
/None
Raises: - ValueError – if
value
isNone
andallow_empty
isFalse
- ValueError – if
minimum
is supplied andvalue
is less than theminimum
- ValueError – if
maximum
is supplied andvalue
is more than themaximum
fraction¶
-
fraction
(value, allow_empty=False, minimum=None, maximum=None)[source]¶ Validate that
value
is aFraction
.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
isNone
. IfFalse
, raises aValueError
ifvalue
isNone
. Defaults toFalse
.
Returns: value
/None
Return type: Fraction
/None
Raises: - ValueError – if
value
isNone
andallow_empty
isFalse
- ValueError – if
minimum
is supplied andvalue
is less than theminimum
- ValueError – if
maximum
is supplied andvalue
is more than themaximum
decimal¶
-
decimal
(value, allow_empty=False, minimum=None, maximum=None)[source]¶ Validate that
value
is aDecimal
.Parameters: - value – The value to validate.
- allow_empty (
bool
) – IfTrue
, returnsNone
ifvalue
isNone
. IfFalse
, raises aValueError
ifvalue
isNone
. Defaults toFalse
. - minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value.
Returns: value
/None
Return type: Decimal
/None
Raises: - ValueError – if
value
isNone
andallow_empty
isFalse
- ValueError – if
minimum
is supplied andvalue
is less than theminimum
- ValueError – if
maximum
is supplied andvalue
is more than themaximum
Checker Reference¶
Core¶
is_type¶
-
is_type
(obj, type_)[source]¶ Indicate if
obj
is a type intype_
.Hint
This checker is particularly useful when you want to evaluate whether
obj
is of a particular type, but importing that type directly to use inisinstance()
would cause a circular import error.To use this checker in that kind of situation, you can instead pass the name of the type you want to check as a string in
type_
. The checker will evaluate it and see whetherobj
is of a type or inherits from a type whose name matches the string you passed.Parameters: Returns: True
ifobj
is a type intype_
. Otherwise,False
.Return type:
are_equivalent¶
-
are_equivalent
(*args)[source]¶ Indicate if arguments passed to this function are equivalent.
Hint
This checker operates recursively on the members contained within iterables and
dict
objects.Caution
If you only pass one argument to this checker - even if it is an iterable - the checker will always return
True
.To evaluate members of an iterable for equivalence, you should instead unpack the iterable into the function like so:
obj = [1, 1, 1, 2] result = are_equivalent(*obj) # Will return ``False`` by unpacking and evaluating the iterable's members result = are_equivalent(obj) # Will always return True
Parameters: args – One or more values, passed as positional arguments. Returns: True
ifargs
are equivalent, andFalse
if not.Return type: bool
are_dicts_equivalent¶
is_between¶
-
is_between
(value, minimum=None, maximum=None)[source]¶ Indicate whether
value
is greater than or equal to a suppliedminimum
and/or less than or equal tomaximum
.Note
This function works on any
value
that support comparison operators, whether they are numbers or not. Technically, this means thatvalue
,minimum
, ormaximum
need to implement the Python magic methods__lte__
and__gte__
.If
value
,minimum
, ormaximum
do not support comparison operators, they will raiseNotImplemented
.Parameters: - value (anything that supports comparison operators) – The
value
to check. - minimum (anything that supports comparison operators /
None
) – If supplied, will returnTrue
ifvalue
is greater than or equal to this value. - maximum (anything that supports comparison operators /
None
) – If supplied, will returnTrue
ifvalue
is less than or equal to this value.
Returns: True
ifvalue
is greater than or equal to a suppliedminimum
and less than or equal to a suppliedmaximum
. Otherwise, returnsFalse
.Return type: Raises: - NotImplemented – if
value
,minimum
, ormaximum
do not support comparison operators - ValueError – if both
minimum
andmaximum
areNone
- value (anything that supports comparison operators) – The
has_length¶
-
has_length
(value, minimum=None, maximum=None)[source]¶ Indicate whether
value
has a length greater than or equal to a suppliedminimum
and/or less than or equal tomaximum
.Note
This function works on any
value
that supports thelen()
operation. This means thatvalue
must implement the__len__
magic method.If
value
does not support length evaluation, the checker will raiseNotImplemented
.Parameters: - value (anything that supports length evaluation) – The
value
to check. - minimum (numeric) – If supplied, will return
True
ifvalue
is greater than or equal to this value. - maximum (numeric) – If supplied, will return
True
ifvalue
is less than or equal to this value.
Returns: True
ifvalue
has length greater than or equal to a suppliedminimum
and less than or equal to a suppliedmaximum
. Otherwise, returnsFalse
.Return type: Raises: - TypeError – if
value
does not support length evaluation - ValueError – if both
minimum
andmaximum
areNone
- value (anything that supports length evaluation) – The
is_dict¶
is_string¶
-
is_string
(value, coerce_value=False, minimum_length=None, maximum_length=None, whitespace_padding=False)[source]¶ Indicate whether
value
is a string.Parameters: - value – The value to evaluate.
- coerce_value (
bool
) – IfTrue
, will check whethervalue
can be coerced to a string if it is not already. Defaults toFalse
. - minimum_length (
int
) – If supplied, indicates the minimum number of characters needed to be valid. - maximum_length (
int
) – If supplied, indicates the minimum number of characters needed to be valid. - whitespace_padding (
bool
) – IfTrue
and the value is below theminimum_length
, pad the value with spaces. Defaults toFalse
.
Returns: True
ifvalue
is valid,False
if it is not.Return type:
is_iterable¶
-
is_iterable
(obj, forbid_literals=(<class 'str'>, <class 'bytes'>), minimum_length=None, maximum_length=None)[source]¶ Indicate whether
obj
is iterable.Parameters: - forbid_literals (iterable) – A collection of literals that will be considered invalid
even if they are (actually) iterable. Defaults to a
tuple
containingstr
andbytes
. - minimum_length (
int
) – If supplied, indicates the minimum number of members needed to be valid. - maximum_length (
int
) – If supplied, indicates the minimum number of members needed to be valid.
Returns: True
ifobj
is a valid iterable,False
if not.Return type: - forbid_literals (iterable) – A collection of literals that will be considered invalid
even if they are (actually) iterable. Defaults to a
is_not_empty¶
is_none¶
is_variable_name¶
-
is_variable_name
(value)[source]¶ Indicate whether
value
is a valid Python variable name.Caution
This function does NOT check whether the variable exists. It only checks that the
value
would work as a Python variable (or class, or function, etc.) name.Parameters: value – The value to evaluate. Returns: True
ifvalue
is valid,False
if it is not.Return type: bool
is_callable¶
Date / Time¶
is_date¶
is_datetime¶
is_time¶
is_timezone¶
-
is_timezone
(value, positive=True)[source]¶ Indicate whether
value
is atzinfo
.Caution
This does not validate whether the value is a timezone that actually exists, nor can it resolve timzone names (e.g.
'Eastern'
or'CET'
).For that kind of functionality, we recommend you utilize: pytz
Parameters: - value – The value to evaluate.
- positive (
bool
) – Indicates whether thevalue
is positive or negative (only has meaning ifvalue
is a string). Defaults toTrue
.
Returns: True
ifvalue
is valid,False
if it is not.Return type:
Numbers¶
is_numeric¶
-
is_numeric
(value, minimum=None, maximum=None)[source]¶ Indicate whether
value
is a numeric value.Parameters: - value – The value to evaluate.
- minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value.
Returns: True
ifvalue
is valid,False
if it is not.Return type:
is_integer¶
-
is_integer
(value, coerce_value=False, minimum=None, maximum=None, base=10)[source]¶ Indicate whether
value
contains a whole number.Parameters: - value – The value to evaluate.
- coerce_value (
bool
) – IfTrue
, will returnTrue
ifvalue
can be coerced to whole number. IfFalse
, will only returnTrue
ifvalue
is already a whole number (regardless of type). Defaults toFalse
. - minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value. - base (
int
) – Indicates the base that is used to determine the integer value. The allowed values are 0 and 2–36. Base-2, -8, and -16 literals can be optionally prefixed with0b/0B
,0o/0O/0
, or0x/0X
, as with integer literals in code. Base 0 means to interpret the string exactly as an integer literal, so that the actual base is 2, 8, 10, or 16. Defaults to10
.
Returns: True
ifvalue
is valid,False
if it is not.Return type:
is_float¶
-
is_float
(value, minimum=None, maximum=None)[source]¶ Indicate whether
value
is afloat
.Parameters: - value – The value to evaluate.
- minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value.
Returns: True
ifvalue
is valid,False
if it is not.Return type:
is_fraction¶
-
is_fraction
(value, minimum=None, maximum=None)[source]¶ Indicate whether
value
is aFraction
.Parameters: - value – The value to evaluate.
- minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value.
Returns: True
ifvalue
is valid,False
if it is not.Return type:
is_decimal¶
-
is_decimal
(value, minimum=None, maximum=None)[source]¶ Indicate whether
value
contains aDecimal
.Parameters: - value – The value to evaluate.
- minimum (numeric) – If supplied, will make sure that
value
is greater than or equal to this value. - maximum (numeric) – If supplied, will make sure that
value
is less than or equal to this value.
Returns: True
ifvalue
is valid,False
if it is not.Return type:
Contributing to the Validator Collection¶
Note
As a general rule of thumb, the Validator Collection applies PEP 8 styling, with some important differences.
Branch | Unit Tests |
---|---|
latest | |
v. 1.0.0 | |
develop |
Contents:
Design Philosophy¶
The Validator Collection is meant to be a “beautiful” and “usable” library. That means that it should offer an idiomatic API that:
- works out of the box as intended,
- minimizes “bootstrapping” to produce meaningful output, and
- does not force users to understand how it does what it does.
In other words:
Users should simply be able to drive the car without looking at the engine.
Style Guide¶
Basic Conventions¶
Do not terminate lines with semicolons.
Line length should have a maximum of approximately 90 characters. If in doubt, make a longer line or break the line between clear concepts.
Each class should be contained in its own file.
If a file runs longer than 2,000 lines…it should probably be refactored and split.
All imports should occur at the top of the file.
Do not use single-line conditions:
# GOOD if x: do_something() # BAD if x: do_something()
When testing if an object has a value, be sure to use
if x is None:
orif x is not None
. Do not confuse this withif x:
andif not x:
.Use the
if x:
construction for testing truthiness, andif not x:
for testing falsiness. This is different from testing:if x is True:
if x is False:
if x is None:
As of right now, because we feel that it negatively impacts readability and is less-widely used in the community, we are not using type annotations.
Naming Conventions¶
variable_name
and notvariableName
orVariableName
. Should be a noun that describes what information is contained in the variable. If abool
, preface withis_
orhas_
or similar question-word that can be answered with a yes-or-no.function_name
and notfunction_name
orfunctionName
. Should be an imperative that describes what the function does (e.g.get_next_page
).CONSTANT_NAME
and notconstant_name
orConstantName
.ClassName
and notclass_name
orClass_Name
.
Design Conventions¶
Functions at the module level can only be aware of objects either at a higher scope or singletons (which effectively have a higher scope).
Functions and methods can use one positional argument (other than
self
orcls
) without a default value. Any other arguments must be keyword arguments with default value given.def do_some_function(argument): # rest of function... def do_some_function(first_arg, second_arg = None, third_arg = True): # rest of function ...
Functions and methods that accept values should start by validating their input, throwing exceptions as appropriate.
When defining a class, define all attributes in
__init__
.When defining a class, start by defining its attributes and methods as private using a single-underscore prefix. Then, only once they’re implemented, decide if they should be public.
Don’t be afraid of the private attribute/public property/public setter pattern:
class SomeClass(object): def __init__(*args, **kwargs): self._private_attribute = None @property def private_attribute(self): # custom logic which may override the default return return self._private_attribute @setter.private_attribute def private_attribute(self, value): # custom logic that creates modified_value self._private_attribute = modified_value
Separate a function or method’s final (or default)
return
from the rest of the code with a blank line (except for single-line functions/methods).
Documentation Conventions¶
We are very big believers in documentation (maybe you can tell). To document the PDF Layer Extractor we rely on several tools:
Sphinx [1]¶
Sphinx [1] is used to organize the library’s documentation into this lovely
readable format (which will also be published to ReadTheDocs [2]). This
documentation is written in reStructuredText [3] files which are stored in
<project>/docs
.
Tip
As a general rule of thumb, we try to apply the ReadTheDocs [2] own Documentation Style Guide [4] to our RST documentation.
Hint
To build the HTML documentation locally:
- In a terminal, navigate to
<project>/docs
. - Execute
make html
.
When built locally, the HTML output of the documentation will be available at
./docs/_build/index.html
.
Docstrings¶
- Docstrings are used to document the actual source code itself. When writing docstrings we adhere to the conventions outlined in PEP 257.
Dependencies¶
The regex drop-in replacement for
Python’s (buggy) standard re
module.
Note
This conditional dependency will be automatically installed if you are installing to Python 2.x.
Preparing Your Development Environment¶
In order to prepare your local development environment, you should:
- Fork the Git repository.
- Clone your forked repository.
- Set up a virtual environment (optional).
- Install dependencies:
validator-collection/ $ pip install -r requirements.txt
And you should be good to go!
Ideas and Feature Requests¶
Check for open issues or create a new issue to start a discussion around a bug or feature idea.
Testing¶
If you’ve added a new feature, we recommend you:
- create local unit tests to verify that your feature works as expected, and
- run local unit tests before you submit the pull request to make sure nothing else got broken by accident.
See also
For more information about the Validator Collection testing approach please see: Testing the Validator Collection
Submitting Pull Requests¶
After you have made changes that you think are ready to be included in the main library, submit a pull request on Github and one of our developers will review your changes. If they’re ready (meaning they’re well documented, pass unit tests, etc.) then they’ll be merged back into the main repository and slated for inclusion in the next release.
Building Documentation¶
In order to build documentation locally, you can do so from the command line using:
validator-collection/ $ cd docs
validator-collection/docs $ make html
When the build process has finished, the HTML documentation will be locally available at:
validator-collection/docs/_build/html/index.html
Note
Built documentation (the HTML) is not included in the project’s Git repository. If you need local documentation, you’ll need to build it.
Testing the Validator Collection¶
Contents
Testing Philosophy¶
Note
Unit tests for the Validator Collection are written using pytest [1] and a comprehensive set of test automation are provided by tox [2].
There are many schools of thought when it comes to test design. When building the Validator Collection, we decided to focus on practicality. That means:
- DRY is good, KISS is better. To avoid repetition, our test suite makes extensive use of fixtures, parametrization, and decorator-driven behavior. This minimizes the number of test functions that are nearly-identical. However, there are certain elements of code that are repeated in almost all test functions, as doing so will make future readability and maintenance of the test suite easier.
- Coverage matters…kind of. We have documented the primary intended behavior of every function in the Validator Collection library, and the most-likely failure modes that can be expected. At the time of writing, we have about 85% code coverage. Yes, yes: We know that is less than 100%. But there are edge cases which are almost impossible to bring about, based on confluences of factors in the wide world. Our goal is to test the key functionality, and as bugs are uncovered to add to the test functions as necessary.
Test Organization¶
Each individual test module (e.g. test_validators.py
) corresponds to a
conceptual grouping of functionality. For example:
test_validators.py
tests validator functions found invalidator_collection/_validators.py
Certain test modules are tightly coupled, as the behavior in one test module may
have implications on the execution of tests in another. These test modules use
a numbering convention to ensure that they are executed in their required order,
so that test_1_NAME.py
is always executed before
test_2_NAME.py
.
Configuring & Running Tests¶
Installing with the Test Suite¶
$ pip install validator-collection[tests]
See also
When you create a local development environment, all dependencies for running and extending the test suite are installed.
Command-line Options¶
The Validator Collection does not use any custom command-line options in its test suite.
Tip
For a full list of the CLI options, including the defaults available, try:
validator-collection $ cd tests/
validator-collection/tests/ $ pytest --help
Configuration File¶
Because the Validator Collection has a very simple test suite, we have not
prepared a pytest.ini
configuration file.
Running Tests¶
tests/ $ pytest
tests/ $ pytest tests/test_module.py
tests/ $ pytest tests/test_module.py -k 'test_my_test_function'
Skipping Tests¶
Note
Because of the simplicity of the Validator Collection, the test suite does not currently support any test skipping.
Incremental Tests¶
Note
The Validator Collection test suite does support incremental testing using, however at the moment none of the tests designed rely on this functionality.
A variety of test functions are designed to test related functionality. As a
result, they are designed to execute incrementally. In order to execute tests
incrementally, they need to be defined as methods within a class that you decorate
with the @pytest.mark.incremental
decorator as shown below:
@pytest.mark.incremental
class TestIncremental(object):
def test_function1(self):
pass
def test_modification(self):
assert 0
def test_modification2(self):
pass
This class will execute the TestIncremental.test_function1()
test, execute and
fail on the TestIncremental.test_modification()
test, and automatically fail
TestIncremental.test_modification2()
because of the .test_modification()
failure.
To pass state between incremental tests, add a state
argument to their method
definitions. For example:
@pytest.mark.incremental
class TestIncremental(object):
def test_function(self, state):
state.is_logged_in = True
assert state.is_logged_in = True
def test_modification1(self, state):
assert state.is_logged_in is True
state.is_logged_in = False
assert state.is_logged_in is False
def test_modification2(self, state):
assert state.is_logged_in is True
Given the example above, the third test (test_modification2
) will fail because
test_modification
updated the value of state.is_logged_in
.
Note
state
is instantiated at the level of the entire test session (one run of
the test suite). As a result, it can be affected by tests in other test modules.
[1] | https://docs.pytest.org/en/latest/ |
[2] | https://tox.readthedocs.io |
Glossary¶
- Checker
- A function which takes an input value and indicates (
True
/False
) whether it is what you expect it to be. Will always return a boolean. - Validator
- A function which takes an input value and ensures that it is what (the type
or contents) you expect it to be. Will return the value or
None
depending on the arguments you pass to it.
The Validator Collection is a Python library that provides more than 60 functions that can be used to validate the type and contents of an input value.
Each function has a consistent syntax for easy use, and has been tested on Python 2.7, 3.4, 3.5, and 3.6.
For a list of validators available, please see the lists below.
Contents
Installation¶
To install the Validator Collection, just execute:
$ pip install validator-collection
Dependencies¶
The regex drop-in replacement for
Python’s (buggy) standard re
module.
Note
This conditional dependency will be automatically installed if you are installing to Python 2.x.
Available Validators and Checkers¶
Core | Date/Time | Numbers | File-related | Internet-related |
---|---|---|---|---|
dict |
date |
numeric |
bytesIO |
email |
string |
datetime |
integer |
stringIO |
url |
iterable |
time |
float |
path |
ip_address |
none |
timezone |
fraction |
path_exists |
ipv4 |
not_empty |
decimal |
file_exists |
ipv6 |
|
uuid |
directory_exists |
mac_address |
||
variable_name |
Hello, World and Standard Usage¶
All validator functions have a consistent syntax so that using them is pretty much identical. Here’s how it works:
from validator_collection import validators, checkers
email_address = validators.email('test@domain.dev')
# The value of email_address will now be "test@domain.dev"
email_address = validators.email('this-is-an-invalid-email')
# Will raise a ValueError
email_address = validators.email(None)
# Will raise a ValueError
email_address = validators.email(None, allow_empty = True)
# The value of email_address will now be None
email_address = validators.email('', allow_empty = True)
# The value of email_address will now be None
is_email_address = checkers.is_email('test@domain.dev')
# The value of is_email_address will now be True
is_email_address = checkers.is_email('this-is-an-invalid-email')
# The value of is_email_address will now be False
is_email_address = checkers.is_email(None)
# The value of is_email_address will now be False
Pretty simple, right? Let’s break it down just in case: Each validator comes in two flavors: a validator and a checker.
Using Validators¶
A validator does what it says on the tin: It validates that an input value is what you think it should be, and returns its valid form.
Each validator is expressed as the name of the thing being validated, for example
email()
.
Each validator accepts a value as its first argument, and an optional allow_empty
boolean as its second argument. For example:
email_address = validators.email(value, allow_empty = True)
If the value you’re validating validates successfully, it will be returned. If the value you’re validating needs to be coerced to a different type, the validator will try to do that. So for example:
validators.integer(1)
validators.integer('1')
will both return an int
of 1
.
If the value you’re validating is empty/falsey and allow_empty
is False
,
then the validator will raise a ValueError
exception. If allow_empty
is True
, then an empty/falsey input value will be converted to a None
value.
Caution
By default, allow_empty
is always set to False
.
If the value you’re validating fails its validation for some reason, the validator
may raise different exceptions depending on the reason. In most cases, this will
be a ValueError
though it can sometimes be a TypeError
, or an
AttributeError
, etc. For specifics on each validator’s likely exceptions
and what can cause them, please review the Validator Reference.
Hint
Some validators (particularly numeric ones like
integer
) have additional
options which are used to make sure the value meets criteria that you set for
it. These options are always included as keyword arguments after the
allow_empty
argument, and are documented for each validator below.
Using Checkers¶
Likewise, a checker is what it sounds like: It checks that an input value
is what you expect it to be, and tells you True
/False
whether it is or not.
Important
Checkers do not verify or convert object types. You can think of a checker as a tool that tells you whether its corresponding validator would fail. See Best Practices for tips and tricks on using the two together.
Each checker is expressed as the name of the thing being validated, prefixed by
is_
. So the checker for an email address is
is_email()
and the checker
for an integer is is_integer()
.
Checkers take the input value you want to check as their first (and often only)
positional argumet. If the input value validates, they will return True
. Unlike
validators, checkers will not raise an exception if
validation fails. They will instead return False
.
Hint
If you need to know why a given value failed to validate, use the validator instead.
Hint
Some checkers (particularly numeric ones like
is_integer
) have additional
options which are used to make sure the value meets criteria that you set for
it. These options are always optional and are included as keyword arguments
after the input value argument. For details, please see the
Checker Reference.
Best Practices¶
Checkers and Validators are designed to be used together. You can think of them as a way to quickly and easily verify that a value contains the information you expect, and then make sure that value is in the form your code needs it in.
There are two fundamental patterns that we find work well in practice.
Defensive Approach: Check, then Convert if Necessary¶
We find this pattern is best used when we don’t have any certainty over a given value might contain. It’s fundamentally defensive in nature, and applies the following logic:
- Check whether
value
contains the information we need it to or can be converted to the form we need it in. - If
value
does not contain what we need but can be converted to what we need, do the conversion. - If
value
does not contain what we need but cannot be converted to what we need, raise an error (or handle it however it needs to be handled).
We tend to use this where we’re first receiving data from outside of our control, so when we get data from a user, from the internet, from a third-party API, etc.
Here’s a quick example of how that might look in code:
from validator_collection import checkers, validators
def some_function(value):
# Check whether value contains a whole number.
is_valid = checkers.is_integer(value,
coerce_value = False)
# If the value does not contain a whole number, maybe it contains a
# numeric value that can be rounded up to a whole number.
if not is_valid and checkers.is_integer(value, coerce_value = True):
# If the value can be rounded up to a whole number, then do so:
value = validators.integer(value, coerce_value = True)
elif not is_valid:
# Since the value does not contain a whole number and cannot be converted to
# one, this is where your code to handle that error goes.
raise ValueError('something went wrong!')
return value
value = some_function(3.14)
# value will now be 4
new_value = some_function('not-a-number')
# will raise ValueError
Let’s break down what this code does. First, we define some_function()
which
takes a value. This function uses the
is_integer()
checker to see if value
contains a whole number, regardless of its type.
If it doesn’t contain a whole number, maybe it contains a numeric value that can
be rounded up to a whole number? It again uses the
is_integer()
to check if that’s
possible. If it is, then it calls the
integer()
validator to coerce
value
to a whole number.
If it can’t coerce value
to a whole number? It raises a ValueError
.
Confident Approach: try … except¶
Sometimes, we’ll have more confidence in the values that we can expect to work
with. This means that we might expect value
to generally have the kind of
data we need to work with. This means that situations where value
doesn’t
contain what we need will truly be exceptional situations, and can be handled
accordingly.
In this situation, a good approach is to apply the following logic:
- Skip a checker entirely, and just wrap the validator in a
try...except
block.
We tend to use this in situations where we’re working with data that our own code has produced (meaning we know - generally - what we can expect, unless something went seriously wrong).
Here’s an example:
from validator_collection import validators
def some_function(value):
try:
email_address = validators.email(value, allow_empty = False)
except ValueError:
# handle the error here
# do something with your new email address value
return email_address
email = some_function('email@domain.com')
# This will return the email address.
email = some_function('not-a-valid-email')
# This will raise a ValueError that some_function() will handle.
email = some_function(None)
# This will raise a ValueError that some_function() will handle.
So what’s this code do? It’s pretty straightforward. some_function()
expects
to receive a value
that contains an email address. We expect that value
will typically be an email address, and not something weird (like a number or
something). So we just try the validator - and if validation fails, we handle
the error appropriately.
Questions and Issues¶
You can ask questions and report issues on the project’s Github Issues Page
Contributing¶
We welcome contributions and pull requests! For more information, please see the Contributor Guide
Testing¶
We use TravisCI for our build automation and ReadTheDocs for our documentation.
Detailed information about our test suite and how to run tests locally can be found in our Testing Reference.