JSON::backportPP (3)
Leading comments
Automatically generated by Pod::Man 4.07 (Pod::Simple 3.32) Standard preamble: ========================================================================
NAME
JSON::PP - JSON::XS compatible pure-Perl module.SYNOPSIS
use JSON::PP; # exported functions, they croak on error # and expect/generate UTF-8 $utf8_encoded_json_text = encode_json $perl_hash_or_arrayref; $perl_hash_or_arrayref = decode_json $utf8_encoded_json_text; # OO-interface $coder = JSON::PP->new->ascii->pretty->allow_nonref; $json_text = $json->encode( $perl_scalar ); $perl_scalar = $json->decode( $json_text ); $pretty_printed = $json->pretty->encode( $perl_scalar ); # pretty-printing # Note that JSON version 2.0 and above will automatically use # JSON::XS or JSON::PP, so you should be able to just: use JSON;
VERSION
2.27200
DESCRIPTION
This module is
FEATURES
- *
-
correct unicode handling
This module knows how to handle Unicode (depending on Perl version).
See to ``A
FEW NOTES ON UNICODE AND PERL''inJSON::XSand ``UNICODE HANDLING ON PERLS''. - *
-
round-trip integrity
When you serialise a perl data structure using only data types supported by
JSONand Perl, the deserialised data structure is identical on the Perl level. (e.g. the string ``2.0'' doesn't suddenly become ``2'' just because it looks like a number). There are minor exceptions to this, read theMAPPINGsection below to learn about those. - *
-
strict checking of JSONcorrectness
There is no guessing, no generating of illegal
JSONtexts by default, and onlyJSONis accepted as input by default (the latter is a security feature). But when some options are set, loose checking features are available.
FUNCTIONAL INTERFACE
Some documents are copied and modified from ``encode_json
$json_text = encode_json $perl_scalar
Converts the given Perl data structure to a
This function call is functionally identical to:
$json_text = JSON::PP->new->utf8->encode($perl_scalar)
decode_json
$perl_scalar = decode_json $json_text
The opposite of "encode_json": expects an
This function call is functionally identical to:
$perl_scalar = JSON::PP->new->utf8->decode($json_text)
JSON::PP::is_bool
$is_boolean = JSON::PP::is_bool($scalar)
Returns true if the passed scalar represents either JSON::PP::true or JSON::PP::false, two constants that act like 1 and 0 respectively and are also used to represent
JSON::PP::true
ReturnsJSON::PP::false
ReturnsJSON::PP::null
Returns "undef".See
HOW DO I DECODE A DATA FROM OUTER AND ENCODE TO OUTER
This section supposes that your perl version is 5.8 or later.If you know a
# from network my $json = JSON::PP->new->utf8; my $json_text = CGI->new->param( 'json_data' ); my $perl_scalar = $json->decode( $json_text ); # from file content local $/; open( my $fh, '<', 'json.data' ); $json_text = <$fh>; $perl_scalar = decode_json( $json_text );
If an outer data is not encoded in
use Encode; local $/; open( my $fh, '<', 'json.data' ); my $encoding = 'cp932'; my $unicode_json_text = decode( $encoding, <$fh> ); # UNICODE # or you can write the below code. # # open( my $fh, "<:encoding($encoding)", 'json.data' ); # $unicode_json_text = <$fh>;
In this case, $unicode_json_text is of course
$perl_scalar = $json->utf8(0)->decode( $unicode_json_text );
Or "encode 'utf8'" and "decode_json":
$perl_scalar = decode_json( encode( 'utf8', $unicode_json_text ) ); # this way is not efficient.
And now, you want to convert your $perl_scalar into
Your data usually contains
print encode_json( $perl_scalar ); # to a network? file? or display? # or print $json->utf8->encode( $perl_scalar );
If $perl_scalar does not contain
# $perl_scalar contains $encoding encoded string values $unicode_json_text = $json->utf8(0)->encode( $perl_scalar ); # $unicode_json_text consists of characters less than 0x100 print $unicode_json_text;
Or "decode $encoding" all string values and "encode_json":
$perl_scalar->{ foo } = decode( $encoding, $perl_scalar->{ foo } ); # ... do it to each string values, then encode_json $json_text = encode_json( $perl_scalar );
This method is a proper way but probably not efficient.
See to Encode, perluniintro.
METHODS
Basically, check tonew
$json = JSON::PP->new
Returns a new
All boolean flags described below are by default disabled.
The mutators for flags all return the
my $json = JSON::PP->new->utf8->space_after->encode({a => [1,2]}) => {"a": [1, 2]}
ascii
$json = $json->ascii([$enable]) $enabled = $json->get_ascii
If $enable is true (or missing), then the encode method will not generate characters outside the code range 0..127. Any Unicode characters outside that range will be escaped using either a single \uXXXX or a double \uHHHH\uLLLLL escape sequence, as per
In Perl 5.005, there is no character having high value (more than 255). See to ``
If $enable is false, then the encode method will not escape Unicode characters unless required by the
JSON::PP->new->ascii(1)->encode([chr 0x10401]) => ["\ud801\udc01"]
latin1
$json = $json->latin1([$enable]) $enabled = $json->get_latin1
If $enable is true (or missing), then the encode method will encode the resulting
If $enable is false, then the encode method will not escape Unicode characters unless required by the
JSON::XS->new->latin1->encode (["\x{89}\x{abc}"] => ["\x{89}\\u0abc"] # (perl syntax, U+abc escaped, U+89 not)
See to ``
utf8
$json = $json->utf8([$enable]) $enabled = $json->get_utf8
If $enable is true (or missing), then the encode method will encode the
(In Perl 5.005, any character outside the range 0..255 does not exist. See to ``
In future versions, enabling this option might enable autodetection of the
If $enable is false, then the encode method will return the
Example, output UTF-16BE-encoded
use Encode; $jsontext = encode "UTF-16BE", JSON::PP->new->encode ($object);
Example, decode UTF-32LE-encoded
use Encode; $object = JSON::PP->new->decode (decode "UTF-32LE", $jsontext);
pretty
$json = $json->pretty([$enable])
This enables (or disables) all of the "indent", "space_before" and "space_after" flags in one call to generate the most readable (or most compact) form possible.
Equivalent to:
$json->indent->space_before->space_after
indent
$json = $json->indent([$enable]) $enabled = $json->get_indent
The default indent space length is three. You can use "indent_length" to change the length.
space_before
$json = $json->space_before([$enable]) $enabled = $json->get_space_before
If $enable is true (or missing), then the "encode" method will add an extra optional space before the ":" separating keys from values in
If $enable is false, then the "encode" method will not add any extra space at those places.
This setting has no effect when decoding
Example, space_before enabled, space_after and indent disabled:
{"key" :"value"}
space_after
$json = $json->space_after([$enable]) $enabled = $json->get_space_after
If $enable is true (or missing), then the "encode" method will add an extra optional space after the ":" separating keys from values in
If $enable is false, then the "encode" method will not add any extra space at those places.
This setting has no effect when decoding
Example, space_before and indent disabled, space_after enabled:
{"key": "value"}
relaxed
$json = $json->relaxed([$enable]) $enabled = $json->get_relaxed
If $enable is true (or missing), then "decode" will accept some extensions to normal
If $enable is false (the default), then "decode" will only accept valid
Currently accepted extensions are:
- *
-
list items can have an end-comma
JSONseparates array elements and key-value pairs with commas. This can be annoying if you writeJSONtexts manually and want to be able to quickly append elements, so this extension accepts comma at the end of such items not just between them:
[ 1, 2, <- this comma not normally allowed ] { "k1": "v1", "k2": "v2", <- this comma not normally allowed }
- *
-
shell-style '#'-comments
Whenever
JSONallows whitespace, shell-style comments are additionally allowed. They are terminated by the first carriage-return or line-feed character, after which more white-space and comments are allowed.[ 1, # this comment not allowed in JSON # neither this one... ]
canonical
$json = $json->canonical([$enable]) $enabled = $json->get_canonical
If $enable is true (or missing), then the "encode" method will output
If $enable is false, then the "encode" method will output key-value pairs in the order Perl stores them (which will likely change between runs of the same script).
This option is useful if you want the same data structure to be encoded as the same
This setting has no effect when decoding
If you want your own sorting routine, you can give a code reference or a subroutine name to "sort_by". See to "JSON::PP OWN METHODS".
allow_nonref
$json = $json->allow_nonref([$enable]) $enabled = $json->get_allow_nonref
If $enable is true (or missing), then the "encode" method can convert a non-reference into its corresponding string, number or null
If $enable is false, then the "encode" method will croak if it isn't passed an arrayref or hashref, as
JSON::PP->new->allow_nonref->encode ("Hello, World!") => "Hello, World!"
allow_unknown
$json = $json->allow_unknown ([$enable]) $enabled = $json->get_allow_unknown
If $enable is true (or missing), then ``encode'' will *not* throw an exception when it encounters values it cannot represent in
If $enable is false (the default), then ``encode'' will throw an exception when it encounters anything it cannot encode as
This option does not affect ``decode'' in any way, and it is recommended to leave it off unless you know your communications partner.
allow_blessed
$json = $json->allow_blessed([$enable]) $enabled = $json->get_allow_blessed
If $enable is true (or missing), then the "encode" method will not barf when it encounters a blessed reference. Instead, the value of the convert_blessed option will decide whether "null" ("convert_blessed" disabled or no "TO_JSON" method found) or a representation of the object ("convert_blessed" enabled and "TO_JSON" method found) is being encoded. Has no effect on "decode".
If $enable is false (the default), then "encode" will throw an exception when it encounters a blessed object.
convert_blessed
$json = $json->convert_blessed([$enable]) $enabled = $json->get_convert_blessed
If $enable is true (or missing), then "encode", upon encountering a blessed object, will check for the availability of the "TO_JSON" method on the object's class. If found, it will be called in scalar context and the resulting scalar will be encoded instead of the object. If no "TO_JSON" method is found, the value of "allow_blessed" will decide what to do.
The "TO_JSON" method may safely call die if it wants. If "TO_JSON" returns other blessed objects, those will be handled in the same way. "TO_JSON" must take care of not causing an endless recursion cycle (== crash) in this case. The name of "TO_JSON" was chosen because other methods called by the Perl core (== not by the user of the object) are usually in upper case letters and to avoid collisions with the "to_json" function or method.
This setting does not yet influence "decode" in any way.
If $enable is false, then the "allow_blessed" setting will decide what to do when a blessed object is found.
filter_json_object
$json = $json->filter_json_object([$coderef])
When $coderef is specified, it will be called from "decode" each time it decodes a
When $coderef is omitted or undefined, any existing callback will be removed and "decode" will not change the deserialised hash in any way.
Example, convert all
my $js = JSON::PP->new->filter_json_object (sub { 5 }); # returns [5] $js->decode ('[{}]'); # the given subroutine takes a hash reference. # throw an exception because allow_nonref is not enabled # so a lone 5 is not allowed. $js->decode ('{"a":1, "b":2}');
filter_json_single_key_object
$json = $json->filter_json_single_key_object($key [=> $coderef])
Works remotely similar to "filter_json_object", but is only called for
This $coderef is called before the one specified via "filter_json_object", if any. It gets passed the single value in the
If $coderef is omitted or undefined, the corresponding callback will be disabled. There can only ever be one callback for a given key.
As this callback gets called less often then the "filter_json_object" one, decoding speed will not usually suffer as much. Therefore, single-key objects make excellent targets to serialise Perl objects into, especially as single-key
Typical names for the single object key are "__class_whatever__", or "$__dollars_are_rarely_used__$" or "}ugly_brace_placement", or even things like "__class_md5sum(classname)__", to reduce the risk of clashing with real hashes.
Example, decode
# return whatever is in $WIDGET{5}: JSON::PP ->new ->filter_json_single_key_object (__widget__ => sub { $WIDGET{ $_[0] } }) ->decode ('{"__widget__": 5') # this can be used with a TO_JSON method in some "widget" class # for serialisation to json: sub WidgetBase::TO_JSON { my ($self) = @_; unless ($self->{id}) { $self->{id} = ..get..some..id..; $WIDGET{$self->{id}} = $self; } { __widget__ => $self->{id} } }
shrink
$json = $json->shrink([$enable]) $enabled = $json->get_shrink
In
In
See to ``OBJECT-ORIENTED
max_depth
$json = $json->max_depth([$maximum_nesting_depth]) $max_depth = $json->get_max_depth
Sets the maximum nesting level (default 512) accepted while encoding or decoding. If a higher nesting level is detected in
Nesting level is defined by number of hash- or arrayrefs that the encoder needs to traverse to reach a given point or the number of "{" or "[" characters without their matching closing parenthesis crossed to reach a given character in a string.
If no argument is given, the highest possible setting will be used, which is rarely useful.
See ``
When a large value (100 or more) was set and it de/encodes a deep nested object/text, it may raise a warning 'Deep recursion on subroutine' at the perl runtime phase.
max_size
$json = $json->max_size([$maximum_string_size]) $max_size = $json->get_max_size
Set the maximum length a
If no argument is given, the limit check will be deactivated (same as when 0 is specified).
See ``
encode
$json_text = $json->encode($perl_scalar)
Converts the given Perl data structure (a simple scalar or a reference to a hash or array) to its
decode
$perl_scalar = $json->decode($json_text)
The opposite of "encode": expects a
decode_prefix
($perl_scalar, $characters) = $json->decode_prefix($json_text)
This works like the "decode" method, but instead of raising an exception when there is trailing garbage after the first
JSON->new->decode_prefix ("[1] the tail") => ([], 3)
INCREMENTAL PARSING
Most of this section are copied and modified from ``In some cases, there is the need for incremental parsing of
This module will only attempt to parse the
The following methods implement this incremental parser.
incr_parse
$json->incr_parse( [$string] ) # void context $obj_or_undef = $json->incr_parse( [$string] ) # scalar context @obj_or_empty = $json->incr_parse( [$string] ) # list context
This is the central parsing function. It can both append new text and extract objects from the stream accumulated so far (both of these functions are optional).
If $string is given, then this string is appended to the already existing
After that, if the function is called in void context, it will simply return without doing anything further. This can be used to add more text in as many chunks as you want.
If the method is called in scalar context, then it will try to extract exactly one
And finally, in list context, it will try to extract as many objects from the stream as it can find and return them, or the empty list otherwise. For this to work, there must be no separators between the
Example: Parse some
my @objs = JSON->new->incr_parse ("[5][7][1,2]");
incr_text
$lvalue_string = $json->incr_text
This method returns the currently stored
This function is useful in two cases: a) finding the trailing text after a
$json->incr_text =~ s/\s*,\s*//;
In Perl 5.005, "lvalue" attribute is not available. You must write codes like the below:
$string = $json->incr_text; $string =~ s/\s*,\s*//; $json->incr_text( $string );
incr_skip
$json->incr_skip
This will reset the state of the incremental parser and will remove the parsed text from the input buffer. This is useful after "incr_parse" died, in which case the input buffer and incremental parser state is left unchanged, to skip the text parsed so far and to reset the parse state.
incr_reset
$json->incr_reset
This completely resets the incremental parser, that is, after this call, it will be as if the parser had never parsed anything.
This is useful if you want to repeatedly parse
See to ``
JSON::PP OWN METHODS
allow_singlequote
$json = $json->allow_singlequote([$enable])
If $enable is true (or missing), then "decode" will accept
$json->allow_singlequote->decode({"foo":'bar'}); $json->allow_singlequote->decode({'foo':"bar"}); $json->allow_singlequote->decode({'foo':'bar'});
As same as the "relaxed" option, this option may be used to parse application-specific files written by humans.
allow_barekey
$json = $json->allow_barekey([$enable])
If $enable is true (or missing), then "decode" will accept bare keys of
As same as the "relaxed" option, this option may be used to parse application-specific files written by humans.
$json->allow_barekey->decode('{foo:"bar"}');
allow_bignum
$json = $json->allow_bignum([$enable])
If $enable is true (or missing), then "decode" will convert the big integer Perl cannot handle as integer into a Math::BigInt object and convert a floating number (any) into a Math::BigFloat.
On the contrary, "encode" converts "Math::BigInt" objects and "Math::BigFloat" objects into
$json->allow_nonref->allow_blessed->allow_bignum; $bigfloat = $json->decode('2.000000000000000000000000001'); print $json->encode($bigfloat); # => 2.000000000000000000000000001
See to ``
loose
$json = $json->loose([$enable])
The unescaped [\x00-\x1f\x22\x2f\x5c] strings are invalid in
$json->loose->decode(qq|["abc def"]|);
See ``
escape_slash
$json = $json->escape_slash([$enable])
According to
If $enable is true (or missing), then "encode" will escape slashes.
indent_length
$json = $json->indent_length($length)
sort_by
$json = $json->sort_by($function_name) $json = $json->sort_by($subroutine_ref)
If $function_name or $subroutine_ref are set, its sort routine are used in encoding
$js = $pc->sort_by(sub { $JSON::PP::a cmp $JSON::PP::b })->encode($obj); # is($js, q|{"a":1,"b":2,"c":3,"d":4,"e":5,"f":6,"g":7,"h":8,"i":9}|); $js = $pc->sort_by('own_sort')->encode($obj); # is($js, q|{"a":1,"b":2,"c":3,"d":4,"e":5,"f":6,"g":7,"h":8,"i":9}|); sub JSON::PP::own_sort { $JSON::PP::a cmp $JSON::PP::b }
As the sorting routine runs in the
If $integer is set, then the effect is same as "canonical" on.
INTERNAL
For developers.- PP_encode_box
-
Returns
{ depth => $depth, indent_count => $indent_count, }
- PP_decode_box
-
Returns
{ text => $text, at => $at, ch => $ch, len => $len, depth => $depth, encoding => $encoding, is_valid_utf8 => $is_valid_utf8, };
MAPPING
This section is copied fromSee to ``
JSON -> PERL
- object
-
A JSONobject becomes a reference to a hash in Perl. No ordering of object keys is preserved (JSONdoes not preserver object key ordering itself).
- array
-
A JSONarray becomes a reference to an array in Perl.
- string
-
A JSONstring becomes a string scalar in Perl - Unicode codepoints inJSONare represented by the same codepoints in the Perl string, so no manual decoding is necessary.
- number
-
A JSONnumber becomes either an integer, numeric (floating point) or string scalar in perl, depending on its range and any fractional parts. On the Perl level, there is no difference between those as Perl handles all the conversion details, but an integer may take slightly less memory and might represent more values exactly than floating point numbers.
If the number consists of digits only, "JSON" will try to represent it as an integer value. If that fails, it will try to represent it as a numeric (floating point) value if that is possible without loss of precision. Otherwise it will preserve the number as a string value (in which case you lose roundtripping ability, as the
JSONnumber will be re-encoded to aJSONstring).Numbers containing a fractional or exponential part will always be represented as numeric (floating point) values, possibly at a loss of precision (in which case you might lose perfect roundtripping ability, but the
JSONnumber will still be re-encoded as aJSONnumber).Note that precision is not accuracy - binary floating point values cannot represent most decimal fractions exactly, and when converting from and to floating point, "JSON" only guarantees precision up to but not including the least significant bit.
When "allow_bignum" is enable, the big integers and the numeric can be optionally converted into Math::BigInt and Math::BigFloat objects.
- true, false
-
These JSONatoms become "JSON::PP::true" and "JSON::PP::false", respectively. They are overloaded to act almost exactly like the numbers 1 and 0. You can check whether a scalar is aJSONboolean by using the "JSON::is_bool" function.
print JSON::PP::true . "\n"; => true print JSON::PP::true + 1; => 1 ok(JSON::true eq '1'); ok(JSON::true == 1);
"JSON" will install these missing overloading features to the backend modules.
- null
-
A JSONnull atom becomes "undef" in Perl.
"JSON::PP::null" returns "undef".
PERL -> JSON
The mapping from Perl to - hash references
-
Perl hash references become JSONobjects. As there is no inherent ordering in hash keys (orJSONobjects), they will usually be encoded in a pseudo-random order that can change between runs of the same program but stays generally the same within a single run of a program. "JSON" optionally sort the hash keys (determined by the canonical flag), so the same data structure will serialise to the sameJSONtext (given same settings and version ofJSON::XS), but this incurs a runtime overhead and is only rarely useful, e.g. when you want to compare someJSONtext against another for equality.
- array references
-
Perl array references become JSONarrays.
- other references
-
Other unblessed references are generally not allowed and will cause an
exception to be thrown, except for references to the integers 0 and
1, which get turned into "false" and "true" atoms in JSON.You can also use "JSON::false" and "JSON::true" to improve readability.
to_json [\0,JSON::PP::true] # yields [false,true]
- JSON::PP::true, JSON::PP::false, JSON::PP::null
-
These special values become JSONtrue andJSONfalse values, respectively. You can also use "\1" and "\0" directly if you want.
JSON::PP::null returns "undef".
- blessed objects
-
Blessed objects are not directly representable in JSON.See the "allow_blessed" and "convert_blessed" methods on various options on how to deal with this: basically, you can choose between throwing an exception, encoding the reference as if it weren't blessed, or provide your own serialiser method.
See to convert_blessed.
- simple scalars
-
Simple Perl scalars (any scalar that is not a reference) are the most
difficult objects to encode: JSON::XSandJSON::PPwill encode undefined scalars asJSON"null" values, scalars that have last been used in a string context before encoding asJSONstrings, and anything else as number value:
# dump as number encode_json [2] # yields [2] encode_json [-3.0e17] # yields [-3e+17] my $value = 5; encode_json [$value] # yields [5] # used as string, so dump as string print $value; encode_json [$value] # yields ["5"] # undef becomes null encode_json [undef] # yields [null]
You can force the type to be a string by stringifying it:
my $x = 3.1; # some variable containing a number "$x"; # stringified $x .= ""; # another, more awkward way to stringify print $x; # perl does it for you, too, quite often
You can force the type to be a number by numifying it:
my $x = "3"; # some variable containing a string $x += 0; # numify it, ensuring it will be dumped as a number $x *= 1; # same thing, the choice is yours.
You can not currently force the type in other, less obscure, ways.
Note that numerical precision has the same meaning as under Perl (so binary to decimal conversion follows the same rules as in Perl, which can differ to other languages). Also, your perl interpreter might expose extensions to the floating point numbers of your platform, such as infinities or NaN's - these cannot be represented in
JSON,and it is an error to pass those in. - Big Number
-
When "allow_bignum" is enable,
"encode" converts "Math::BigInt" objects and "Math::BigFloat"
objects into JSONnumbers.
UNICODE HANDLING ON PERLS
If you do not know about Unicode on Perl well, please check ``APerl 5.8 and later
Perl can handle Unicode and the
$json->allow_nonref->encode(chr hex 3042); $json->allow_nonref->encode(chr hex 12345);
Returns "\u3042" and "\ud808\udf45" respectively.
$json->allow_nonref->decode('"\u3042"'); $json->allow_nonref->decode('"\ud808\udf45"');
Returns
Note that the versions from Perl 5.8.0 to 5.8.2, Perl built-in "join" was broken, so
Perl 5.6
Perl can handle Unicode and thePerl 5.005
Perl 5.005 is a byte semantics world --- all strings are sequences of bytes. That means the unicode handling is not available.In encoding,
$json->allow_nonref->encode(chr hex 3042); # hex 3042 is 12354. $json->allow_nonref->encode(chr hex 12345); # hex 12345 is 74565.
Returns "B" and "E", as "chr" takes a value more than 255, it treats as "$value % 256", so the above codes are equivalent to :
$json->allow_nonref->encode(chr 66); $json->allow_nonref->encode(chr 69);
In decoding,
$json->decode('"\u00e3\u0081\u0082"');
The returned is a byte sequence "0xE3 0x81 0x82" for
Next,
$json->decode('"\u3042"');
We ordinary expect the returned value is a Unicode character "U+3042". But here is 5.005 world. This is "0xE3 0x81 0x82".
$json->decode('"\ud808\udf45"');
This is not a character "U+12345" but bytes - "0xf0 0x92 0x8d 0x85".
TODO
- speed
- memory saving
SEE ALSO
Most of the document are copied and modified from
AUTHOR
Makamaka Hannyaharamitu, <makamaka[at]cpan.org>COPYRIGHT AND LICENSE
Copyright 2007-2012 by Makamaka HannyaharamituThis library is free software; you can redistribute it and/or modify it under the same terms as Perl itself.