File: //opt/alt/python37/lib/python3.7/site-packages/jmespath/__pycache__/parser.cpython-37.pyc
B
�P�e�J � @ sp d Z ddlZddlmZ ddlmZ ddlmZ ddlmZ ddlmZ G dd � d e �Z
eG d
d � d e ��Z dS ) a� Top down operator precedence parser.
This is an implementation of Vaughan R. Pratt's
"Top Down Operator Precedence" parser.
(http://dl.acm.org/citation.cfm?doid=512927.512931).
These are some additional resources that help explain the
general idea behind a Pratt parser:
* http://effbot.org/zone/simple-top-down-parsing.htm
* http://javascript.crockford.com/tdop/tdop.html
A few notes on the implementation.
* All the nud/led tokens are on the Parser class itself, and are dispatched
using getattr(). This keeps all the parsing logic contained to a single
class.
* We use two passes through the data. One to create a list of token,
then one pass through the tokens to create the AST. While the lexer actually
yields tokens, we convert it to a list so we can easily implement two tokens
of lookahead. A previous implementation used a fixed circular buffer, but it
was significantly slower. Also, the average jmespath expression typically
does not have a large amount of token so this is not an issue. And
interestingly enough, creating a token list first is actually faster than
consuming from the token iterator one token at a time.
� N)�lexer)�with_repr_method)�ast)�
exceptions)�visitorc @ s� e Zd Zddddddddddddddddddddddddd d
d d d
d� ZdZi ZdZdxdd�Zdd� Zdd� Z dd� Z
dydd�Z dd � Z d d � Z
d d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Zd5d6� Zd7d8� Zd9d:� Zd;d<� Z d=d>� Z d?d@� Z dAdB� Z dCdD� Z dEdF� Z!dGdH� Z"dIdJ� Z#dKdL� Z$dMdN� Z%dOdP� Z&dQdR� Z'dSdT� Z(dUdV� Z)dWdX� Z*dYdZ� Z+d[d\� Z,d]d^� Z-d_d`� Z.dadb� Z/dzddde�Z0dfdg� Z1dhdi� Z2djdk� Z3dldm� Z4dndo� Z5dpdq� Z6drds� Z7dtdu� Z8e9dvdw� �Z:dcS ){�Parserr � � � � � � � �( �- �2 �7 �< ) �eof�unquoted_identifier�quoted_identifier�literal�rbracket�rparen�comma�rbrace�number�current�expref�colon�pipe�or�and�eq�gt�lt�gte�lte�ne�flatten�star�filter�dot�not�lbrace�lbracket�lparen�
� c C s" d | _ d g| | _|| _d| _d S )Nr )� tokenizer�_tokensZ _buffer_size�_index)�self� lookahead� r8 �@/opt/alt/python37/lib/python3.7/site-packages/jmespath/parser.py�__init__N s zParser.__init__c C sH | j �|�}|d k r|S | �|�}|| j |< t| j �| jkrD| �� |S )N)�_CACHE�get� _do_parse�len� _MAX_SIZE�_free_cache_entries)r6 �
expression�cached�
parsed_resultr8 r8 r9 �parseT s
z Parser.parsec
C s� y
| � |�S tjk
r6 } z ||_� W d d }~X Y nZ tjk
rd } z|�|� � W d d }~X Y n, tjk
r� } z ||_� W d d }~X Y nX d S )N)�_parser Z
LexerErrorrA �IncompleteExpressionErrorZset_expression�
ParseError)r6 rA �er8 r8 r9 r= ^ s
zParser._do_parsec C sr t �� �|�| _t| j�| _d| _| jdd�}| �� dksh| � d�}t
� |d |d |d d|d ��t ||�S )Nr )�
binding_powerr �start�value�typezUnexpected token: %s)
r �Lexer�tokenizer3 �listr4 r5 � _expression�_current_token�_lookahead_tokenr rG � ParsedResult)r6 rA �parsed�tr8 r8 r9 rE k s
z
Parser._parsec C s� | � d�}| �� t| d|d | j�}||�}| �� }xX|| j| k r�t| d| d �}|d krv| � d�}| �|� q:| �� ||�}| �� }q:W |S )Nr z
_token_nud_%srL z
_token_led_%s)rR �_advance�getattr�_error_nud_tokenrQ �
BINDING_POWER�_error_led_token)r6 rI Z
left_tokenZ nud_function�left�
current_tokenZledZ error_tokenr8 r8 r9 rP v s
zParser._expressionc C s t �|d �S )NrK )r r )r6 �tokenr8 r8 r9 �_token_nud_literal� s zParser._token_nud_literalc C s t �|d �S )NrK )r �field)r6 r] r8 r8 r9 � _token_nud_unquoted_identifier� s z%Parser._token_nud_unquoted_identifierc C s@ t �|d �}| �� dkr<| �d�}t�d|d |d d��|S )NrK r0 r rL z1Quoted identifier not allowed for function names.)r r_ rQ rR r rG )r6 r] r_ rU r8 r8 r9 � _token_nud_quoted_identifier� s
z#Parser._token_nud_quoted_identifierc C s: t �� }| �� dkr t �� }n| �| jd �}t �||�S )Nr r* )r �identityrQ �_parse_projection_rhsrY �value_projection)r6 r] r[ �rightr8 r8 r9 �_token_nud_star� s
zParser._token_nud_starc C s | � t�� �S )N)�_token_led_filterr rb )r6 r] r8 r8 r9 �_token_nud_filter� s zParser._token_nud_filterc C s | � � S )N)�_parse_multi_select_hash)r6 r] r8 r8 r9 �_token_nud_lbrace� s zParser._token_nud_lbracec C s | � � }| �d� |S )Nr )rP �_match)r6 r] rA r8 r8 r9 �_token_nud_lparen� s
zParser._token_nud_lparenc C s* t �t �� �}| �| jd �}t �||�S )Nr) )r r) rb rc rY �
projection)r6 r] r[ re r8 r8 r9 �_token_nud_flatten� s zParser._token_nud_flattenc C s | � | jd �}t�|�S )Nr- )rP rY r Znot_expression)r6 r] �exprr8 r8 r9 �_token_nud_not� s zParser._token_nud_notc C sz | � � dkr$| �� }| �t�� |�S | � � dkrn| �d�dkrn| �� | �� | �| jd �}t� t�� |�S | �
� S d S )N)r r r* r r ) rQ �_parse_index_expression�_project_if_slicer rb �
_lookaheadrV rc rY rm �_parse_multi_select_list)r6 r] re r8 r8 r9 �_token_nud_lbracket� s zParser._token_nud_lbracketc C sR | � d�dks | � d�dkr$| �� S t�| �d�d �}| �� | �d� |S d S )Nr r r rK r )rs �_parse_slice_expressionr �indexrR rV rk )r6 �noder8 r8 r9 rq � s
z Parser._parse_index_expressionc C s� d d d g}d}| � � }x�|dks�|dk r�|dkr\|d7 }|dkrR| �| �d�d� | �� n6|dkr�| �d�d ||< | �� n| �| �d�d� | � � }qW | �d� tj|� S ) Nr r r
r r z syntax errorr rK )rQ � _raise_parse_error_for_tokenrR rV rk r �slice)r6 �partsrw r\ r8 r8 r9 rv � s$
z Parser._parse_slice_expressionc C s t �� S )N)r Z current_node)r6 r] r8 r8 r9 �_token_nud_current� s zParser._token_nud_currentc C s | � | jd �}t�|�S )Nr )rP rY r r )r6 r] rA r8 r8 r9 �_token_nud_expref� s zParser._token_nud_exprefc C sr | � � dksJ| �| jd �}|d dkr:|d �|� |S t�||g�S n$| �� | �| jd �}t�||�S d S )Nr* r, rL �
subexpression�children) rQ �_parse_dot_rhsrY �appendr r~ rV rc rd )r6 r[ re r8 r8 r9 �_token_led_dot� s zParser._token_led_dotc C s | � | jd �}t�||�S )Nr )rP rY r r )r6 r[ re r8 r8 r9 �_token_led_pipe s zParser._token_led_pipec C s | � | jd �}t�||�S )Nr! )rP rY r Z
or_expression)r6 r[ re r8 r8 r9 �
_token_led_or s zParser._token_led_orc C s | � | jd �}t�||�S )Nr" )rP rY r Zand_expression)r6 r[ re r8 r8 r9 �_token_led_and
s zParser._token_led_andc C s� |d dkr:| � d�}t�|d |d |d d|d ��|d }g }x8| �� dks~| �� }| �� dkrr| �d� |�|� qHW | �d� t�||�}|S ) NrL r_ ���rJ rK zInvalid function name '%s'r r ) rR r rG rQ rP rk r� r Zfunction_expression)r6 r[ Zprev_t�name�argsrA Z
function_noder8 r8 r9 �_token_led_lparen s
zParser._token_led_lparenc C sH | � d�}| �d� | �� dkr*t�� }n| �| jd �}t�|||�S )Nr r r) r+ )rP rk rQ r rb rc rY Zfilter_projection)r6 r[ � conditionre r8 r8 r9 rg % s
zParser._token_led_filterc C s | � |d�S )Nr# )�_parse_comparator)r6 r[ r8 r8 r9 �
_token_led_eq/ s zParser._token_led_eqc C s | � |d�S )Nr( )r� )r6 r[ r8 r8 r9 �
_token_led_ne2 s zParser._token_led_nec C s | � |d�S )Nr$ )r� )r6 r[ r8 r8 r9 �
_token_led_gt5 s zParser._token_led_gtc C s | � |d�S )Nr& )r� )r6 r[ r8 r8 r9 �_token_led_gte8 s zParser._token_led_gtec C s | � |d�S )Nr% )r� )r6 r[ r8 r8 r9 �
_token_led_lt; s zParser._token_led_ltc C s | � |d�S )Nr' )r� )r6 r[ r8 r8 r9 �_token_led_lte> s zParser._token_led_ltec C s& t �|�}| �| jd �}t �||�S )Nr) )r r) rc rY rm )r6 r[ re r8 r8 r9 �_token_led_flattenA s
zParser._token_led_flattenc C s~ | � d�}|d dkrJ| �� }|d dkr<|d �|� |S | �||�S n0| �d� | �d� | �| jd �}t�||�S d S )Nr rL )r r �index_expressionr r* r ) rR rq r� rr rk rc rY r rm )r6 r[ r] re r8 r8 r9 �_token_led_lbracketG s
zParser._token_led_lbracketc C s: t �||g�}|d dkr2t �|| �| jd ��S |S d S )NrL rz r* )r r� rm rc rY )r6 r[ re Z
index_exprr8 r8 r9 rr Z s zParser._project_if_slicec C s | � | j| �}t�|||�S )N)rP rY r �
comparator)r6 r[ r� re r8 r8 r9 r� c s zParser._parse_comparatorc C sJ g }x0| � � }|�|� | �� dkr(P q| �d� qW | �d� t�|�S )Nr r )rP r� rQ rk r Zmulti_select_list)r6 Z expressionsrA r8 r8 r9 rt g s
z Parser._parse_multi_select_listc C s� g }x�| � d�}| jddgd� |d }| �d� | �d�}tj||d�}|�|� | �� dkrl| �d� q| �� d kr| �d � P qW tj|d
�S ) Nr r r )� token_typesrK r )�key_namerx r r )Znodes) rR �_match_multiple_tokensrk rP r Z key_val_pairr� rQ Zmulti_select_dict)r6 �pairsZ key_tokenr� rK rx r8 r8 r9 ri s s
z Parser._parse_multi_select_hashc C s� | j | �� | jk r t�� }nd| �� dkr6| �|�}nL| �� dkrN| �|�}n4| �� dkrp| �d� | �|�}n| �| � d�d� |S )Nr/ r+ r, r z syntax error)
rY rQ �_PROJECTION_STOPr rb rP rk r� ry rR )r6 rI re r8 r8 r9 rc � s
z Parser._parse_projection_rhsc C s� | � � }|dkr| �|�S |dkr4| �d� | �� S |dkrN| �d� | �� S | �d�}ddddg}d||d f }| �||� d S ) N)r r r* r/ r. r r r zExpecting: %s, got: %srL )rQ rP rk rt ri rR ry )r6 rI r7 rU �allowed�msgr8 r8 r9 r� � s
zParser._parse_dot_rhsc C s6 |d dkr&t �|d |d |d ��| �|d� d S )NrL r rJ rK z
invalid token)r rF ry )r6 r] r8 r8 r9 rX � s zParser._error_nud_tokenc C s | � |d� d S )Nz
invalid token)ry )r6 r] r8 r8 r9 rZ � s zParser._error_led_tokenNc C s, | � � |kr| �� n| �|| �d�� d S )Nr )rQ rV � _raise_parse_error_maybe_eofrR )r6 �
token_typer8 r8 r9 rk � s
z
Parser._matchc C s* | � � |kr | �|| �d�� | �� d S )Nr )rQ r� rR rV )r6 r� r8 r8 r9 r� � s z Parser._match_multiple_tokensc C s | j d7 _ d S )Nr )r5 )r6 r8 r8 r9 rV � s zParser._advancec C s | j | j d S )NrL )r4 r5 )r6 r8 r8 r9 rQ � s zParser._current_tokenc C s | j | j| d S )NrL )r4 r5 )r6 r r8 r8 r9 rs � s zParser._lookaheadc C s | j | j| S )N)r4 r5 )r6 r r8 r8 r9 rR � s zParser._lookahead_tokenc C s, |d }|d }|d }t �||||��d S )NrJ rK rL )r rG )r6 r] �reason� lex_position� actual_value� actual_typer8 r8 r9 ry � s
z#Parser._raise_parse_error_for_tokenc C sN |d }|d }|d }|dkr.t �|||��d||f }t �||||��d S )NrJ rK rL r zExpecting: %s, got: %s)r rF rG )r6 �
expected_typer] r� r� r� �messager8 r8 r9 r� � s
z#Parser._raise_parse_error_maybe_eofc C s< x6t �t| j�� �t| jd ��D ]}| j�|d � q"W d S )Nr )�random�samplerO r; �keys�intr? �pop)r6 �keyr8 r8 r9 r@ � s &zParser._free_cache_entriesc C s | j �� dS )z'Clear the expression compilation cache.N)r; �clear)�clsr8 r8 r9 �purge� s z Parser.purge)r )r )N);�__name__�
__module__� __qualname__rY r� r; r? r: rD r= rE rP r^ r` ra rf rh rj rl rn rp ru rq rv r| r} r� r� r� r� r� rg r� r� r� r� r� r� r� r� rr r� rt ri rc r� rX rZ rk r� rV rQ rs rR ry r� r@ � classmethodr� r8 r8 r8 r9 r % s�
r c @ s. e Zd Zdd� Zd
dd�Zdd� Zdd � ZdS ) rS c C s || _ || _d S )N)rA rT )r6 rA rT r8 r8 r9 r: � s zParsedResult.__init__Nc C s t �|�}|�| j|�}|S )N)r ZTreeInterpreter�visitrT )r6 rK �options� interpreter�resultr8 r8 r9 �search� s
zParsedResult.searchc C s t �� }|�| j�}|S )af Render the parsed AST as a dot file.
Note that this is marked as an internal method because
the AST is an implementation detail and is subject
to change. This method can be used to help troubleshoot
or for development purposes, but is not considered part
of the public supported API. Use at your own risk.
)r ZGraphvizVisitorr� rT )r6 �renderer�contentsr8 r8 r9 �_render_dot_file s
z ParsedResult._render_dot_filec C s
t | j�S )N)�reprrT )r6 r8 r8 r9 �__repr__ s zParsedResult.__repr__)N)r� r� r� r: r� r� r� r8 r8 r8 r9 rS � s
rS ) �__doc__r� �jmespathr Zjmespath.compatr r r r �objectr rS r8 r8 r8 r9 �<module> s S