htSrSSKJr SSKJr SSKJr SSKJr SSKJr SrSr"SS 5r "S S 5r g ) z9 Python Lexical Analyser Lexical Analyser Specification )Actions)DFA)Errors)Machines)Regexpsc&\rSrSrSrSrSrSrSrg)Statez This class is used as part of a Plex.Lexicon specification to introduce a user-defined state. Constructor: State(name, token_specifications) NcXlX lgNnametokens)selfrrs N/var/www/fran/franai/venv/lib/python3.13/site-packages/Cython/Plex/Lexicons.py__init__State.__init__s   r) __name__ __module__ __qualname____firstlineno____doc__rrr__static_attributes__rrr r s D Frr c<\rSrSrSrSrSrS SjrSrSr Sr Sr g) Lexicon$a Lexicon(specification) builds a lexical analyser from the given |specification|. The specification consists of a list of specification items. Each specification item may be either: 1) A token definition, which is a tuple: (pattern, action) The |pattern| is a regular axpression built using the constructors defined in the Plex module. The |action| is the action to be performed when this pattern is recognised (see below). 2) A state definition: State(name, tokens) where |name| is a character string naming the state, and |tokens| is a list of token definitions as above. The meaning and usage of states is described below. Actions ------- The |action| in a token specification may be one of three things: 1) A function, which is called as follows: function(scanner, text) where |scanner| is the relevant Scanner instance, and |text| is the matched text. If the function returns anything other than None, that value is returned as the value of the token. If it returns None, scanning continues as if the IGNORE action were specified (see below). 2) One of the following special actions: IGNORE means that the recognised characters will be treated as white space and ignored. Scanning will continue until the next non-ignored token is recognised before returning. TEXT causes the scanned text itself to be returned as the value of the token. 3) Any other value, which is returned as the value of the token. States ------ At any given time, the scanner is in one of a number of states. Associated with each state is a set of possible tokens. When scanning, only tokens associated with the current state are recognised. There is a default state, whose name is the empty string. Token definitions which are not inside any State definition belong to the default state. The initial state of the scanner is the default state. The state can be changed in one of two ways: 1) Using Begin(state_name) as the action of a token. 2) Calling the begin(state_name) method of the Scanner. To change back to the default state, use '' as the state name. Nc[U[5(d[R"S5e[R "5nUR S5nSnUHn[U[5(aGUR UR5nURHn URXHX5 US- nM M_[U[5(aURXEXv5 US- nM[R"US5e U(a,US-(a"URS5 URU5 [R "XCS-S:H=(a US9n U(a,US-(a"URS 5 U RU5 Xlg) Nz Scanner definition is not a listrz5Expected a token definition (tuple) or State instancez ============= NFA =========== )debugrz ============= DFA =========== ) isinstancelistrInvalidScannerrMachinenew_initial_stater rradd_token_to_machinetuple InvalidTokenwritedumpr nfa_to_dfamachine) rspecificationsr# debug_flagsnfadefault_initial_state token_numberspecuser_initial_statetokendfas rrLexicon.__init__osJ.$//''(JK K  # 5 5b 9 "D$&&%(%:%:499%E"![[E--F A%L)D%(())D! )) KMM# kAo KK; < HHUOnnSqQ(>(H5I kAo KK; < HHUO rcURU5upV[U[R5(aUnO#UR [R "U5nUR5nURXUSSS9 URXt*S9 g![ a [R"U5nNUf=f![Ran U RSXI4-5eSn A ff=f)Nr) match_bolnocase)priorityzToken number %d: %s)parse_token_definitionr$rAction__call__CallAttributeErrorReturn new_state build_machine set_actionr PlexError __class__) rr/ initial_state token_specr4re action_specaction final_statees rr)Lexicon.add_token_to_machines I $ ; ;J G R+w~~66$7((%\\+6F!++-K   W['(  4  " "6M " B&9$^^K8F9 I++3|6GGH H Is;5B3 B AB3 B0-B3/B00B33C!CC!c[U[5(d[R"S5e[ U5S:wa[R"S5eUup#[U[ R 5(d[R"S5eX#4$)NzToken definition is not a tuplerz)Wrong number of items in token definitionzPattern is not an RE instance)r$r*rr+lenrRE)rrKpatternrNs rr?Lexicon.parse_token_definitionsr*e,,%%&GH H z?a %%&QR R$'7::..%%&EF F  rc8URRU5$r )r/get_initial_state)rrs rrXLexicon.get_initial_states||--d33r)r/)N) rrrrrr/tablesrr)r?rXrrrrrr$s+ENG F"HI& !4rrN) rr!rrrrrDUMP_NFADUMP_DFAr rrrrr^s=   $N4N4r