*jdZddlmZddlmZddlmZddlmZddl Z ddl Z ddl m Z e rddl mZmZd Zdd Zdd Zdd ZGd deZddZddZy)z6 :func:`~pandas.eval` source string parsing functions ) annotations)Enum)StringIO) iskeywordN) TYPE_CHECKING)HashableIteratordc |jr t|s|Sd|D}djd|D}tjj Dcic]\}}|dt j|d}}}|jdddddd d d d d d dj|Dcgc]}|j||c}}d|}|jstd|d|Scc}}wcc}w)aj Create valid Python identifiers from any string. Check if name contains any special characters. If it contains any special characters, the special characters will be replaced by a special string and a prefix is added. Raises ------ SyntaxError If the returned name is not a Python valid identifier, raise an exception. c 3pK|].}|djd|jddDf0yw)c32K|]}t|yw)N)chr).0bs AC:\FundamentalWorkbench\vendor\pandas\core\computation\parsing.py z;create_valid_python_identifier...+sJ$IqCF$IsasciibackslashreplaceN)joinencode)rcs rrz1create_valid_python_identifier..*s8 A BGGJAHHW6H$IJ JKs46r c3TK|] \}}|jd||k7rdnd"yw)\ _UNICODE_ _BACKSLASH_N)replace)rr c_escapeds rrz1create_valid_python_identifier...s1LAy $qI~ =Qs&(__QUESTIONMARK__EXCLAMATIONMARK_ _DOLLARSIGN_ _EUROSIGN_ _DEGREESIGN_ _SINGLEQUOTE_ _DOUBLEQUOTE__HASH_ _BACKTICK_)  ?!$u€°'"#`BACKTICK_QUOTED_STRING_zCould not convert 'z' to a valid Python identifier.) isidentifierrrtokenizeEXACT_TOKEN_TYPESitemstokentok_nameupdateget SyntaxError)namegenchartokvalspecial_characters_replacementss rcreate_valid_python_identifierrAs5 9T?   C 77 D&77==?'?LD& %..()++?$'$**!$      77PTUPT377dCPTU VD $TF +D    /v5TUVV K3'&Vs "C60C<c\|\}}|tk(rtjt|fS||fS)a[ Clean up a column name if surrounded by backticks. Backtick quoted string are indicated by a certain tokval value. If a string is a backtick quoted token it will processed by :func:`_create_valid_python_identifier` so that the parser can find this string when the query is executed. In this case the tok will get the NAME tokval. Parameters ---------- tok : tuple of int, str ints correspond to the all caps constants in the tokenize module Returns ------- tok : Tuple[int, str] Either the input or token or the replacement values )BACKTICK_QUOTED_STRINGr4NAMErA)toktoknumr?s rclean_backtick_quoted_toksrGRs5(NFF ''}}c t|tr|jddn|}td|d}t |d}t |S#t $r|cYSwxYw)a Function to emulate the cleaning of a backtick quoted name. The purpose for this function is to see what happens to the name of identifier if it goes to the process of being parsed a Python code inside a backtick quoted string and than being cleaned (removed of any special characters). Parameters ---------- name : hashable Name to be cleaned. Returns ------- name : hashable Returns the name after tokenizing and cleaning. r1z``) isinstancestrrtokenize_stringnextrAr;)r< tokenizedr?s rclean_column_namerPlsa&*4T3*?t||C&T#avQK0 i#-f55  sA A AAceZdZdZdZdZdZy) ParseStaterrJN)__name__ __module__ __qualname__DEFAULT IN_BACKTICKIN_SINGLE_QUOTEIN_DOUBLE_QUOTErHrrRrRsGKOOrHrRcLg}g}d}tj}|t|kr||}|xdk(r|tjk(r=|r"|jddj |f|g}|dz }tj }k|tj k(rD|t|dz k7r||dznd}|dk(r(|j||j||dz }|j||jddj |fg}|dz }tj}xd k(rT|tjk(rtj }n|tj k(rs||dz d k7rhtj}nWd k(rS|tjk(rtj}n/|tjk(r||dz d k7rtj} |j||dz }|t|kr|r"|jddj |f|S) a Splits a str into substrings along backtick characters (`). Disregards backticks inside quotes. Parameters ---------- s : str The Python source code string. Returns ------- substrings: list[tuple[bool, str]] List of tuples, where each tuple has two elements: The first is a boolean indicating if the substring is backtick-quoted. The second is the actual substring. rr1Fr rJNrSTr.rr/)rRrXlenappendrrYrZr[)s substringssubstri parse_stater> next_chars r_split_by_backtickrfs$JF A$$K c!f*t*"4"44"))5"''&/*BC"VFFA","8"8K J$:$::-.#a&1*_!a%4I C' d+ i0Q  d+"))4*AB!#Q&0&8&8  *"4"44","<".s< .H )  " +9Qr? ; .Hs!N)rrfrreadliner4generate_tokens)source line_readertoken_generatorrFr?rs rrMrMsl WW .@-G F6"++K..{;O#21afn$3sA A")r<rLreturnrL)rEtuple[int, str]rqrr)r<rrqr)r`rLrqzlist[tuple[bool, str]])rnrLrqzIterator[tuple[int, str]])__doc__ __future__renumriorkeywordrr7r4typingrcollections.abcrr rCrArGrPrRrfrMr\rHrrzsY#   7t4<K\rH