7h'[<SrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK J r SSKJ r SSK J r JrJrJrJr SSKJr SSKJr SSKJr SSKrSS KJr S S KJrJrJrJr S S K J!r!J"r"J#r# S S K$J%r%J&r&J'r'J(r(J)r)J*r*J+r+J,r,J-r-J.r. S SK/J0r0J1r1 S SK2J3r3J4r4J5r5J6r6 S SK7J8r8J9r9J:r:J;r;Jr>J?r?J@r@ SSKAJBrBJCrCJDrDJErE SSKFJGrG SSKHJIrI \(aSSKKJLrL SSKMJNrN SSKOJPrPJQrQ \"S\S9rRSrSSrT\"5rU"SS5rVS\ S\V4S jrWS!rXSgShS"jjrYShS#jrZS$\[\\\E44S%jr]S&r^1S'kr_S(r`"S)S*\E5ra"S+S,\a5rb"S-S.\a5rc"S/S0\E5rd"S1S2\d5re"S3S4\a5rf"S5S6\f5rg"S7S8\b5rh"S9S:\h5ri"S;S<\b5rjShS=jrk"S>S?\a5rl"S@SA\l5rm"SBSC\E5rn"SDSE\n5ro"SFSG\E5rp"SHSI\p5rqSJrrShSKjrs"SLSM\b5rt"SNSO\b5ru"SPSQ\b5rv"SRSS\E5rw"STSU\E5rx"SVSW\E5ry"SXSY\E5rzSSZKOJ{r{J|r|J}r}J~r~ "S[S\\~5r\"5r"S]S^\E5r"S_S`\E5r"SaSb\E5r"ScSd\E5r"SeSf\E5rg!\Ja SrIGNf=f)ia Function-related variable tracking classes for Dynamo's symbolic execution. This module contains classes that track different types of functions during graph compilation, including: - User-defined functions and methods - Built-in functions and methods - Wrapped functions (e.g. from decorators) - Special function types (e.g. functools.partial) - Triton kernels and related function types These classes are responsible for: - Tracking function calls and their arguments - Managing function closures and cell variables - Handling function attributes and special methods - Maintaining guards for function identity and closure contents - Supporting function inlining and specialization - Enabling proper symbolic execution of different function types The variable trackers here work together with the rest of Dynamo to enable accurate graph capture while handling Python's various function-related behaviors. N)Sequence FunctionType)AnyCallableOptional TYPE_CHECKINGTypeVar)Never)patch)WeakKeyDictionary)get_stack_above_dynamo)configgraph_break_hints polyfills variables)create_call_function create_rot_n is_generator) get_dynamo_observed_exceptionhandle_observed_exceptionInfiniteGeneratorErrorObservedExceptionObservedGeneratorExitObservedUserStopIterationraise_observed_exception SkipFrameunimplemented_v2 Unsupported) GuardBuilder install_guard) AttrSourceConstantSourceDefaultsSource GetItemSource) check_constant_argscheck_unspec_or_constant_argscmp_name_to_op_mappingcountersidentity is_functionis_wrapper_or_member_descriptoristype make_cell)#AsPythonConstantNotImplementedErrorAttributeMutationNewValueMutationNewVariableTrackerConstantVariable)_fsdp_param_group) PyCodegenInstructionTranslator)TritonGridTypeTritonKernelType_F)boundc0\rSrSrS\4SjrS\4SjrSrg) FunctionSpechfunccURnURnURUlURUlUR UlUSURUlX0RUR Ul URUR-Ul X0R UR UR-Ul UR UR-nUR[-(aX4OSUlX@R(aSOS- nUR[-(a X4UlgSUlg)Nr0r)__code__ co_varnamesco_posonlyargcount posonly_count co_argcount arg_countco_kwonlyargcount kwonly_count posonly_namespos_or_kw_names all_pos_names kwonly_namesco_flags CO_VARARGS varargs_nameCO_VARKEYWORDS varkw_name)selfrDcodevnoffs [/var/www/fran/franai/venv/lib/python3.13/site-packages/torch/_dynamo/variables/functions.py__init__FunctionSpec.__init__is}}   !44)) 22 4$"4"45!"4"4t~~F!//$2F2FF~~ARAR0RSnnt000'+}}z'ABGt %%q1,%)]]^%C"'c UR=(d SUlUR=(d 0Ul[ [ UR [UR5*S[[UR5555Ul gN) __defaults__defaults__kwdefaults__ kwdefaultsdictziprPlenrangepos_default_map)rWrDs r[update_defaultsFunctionSpec.update_defaults{si))/R --3 $ ""C $6#6#895T]]AS;T U r^) rPrKrcrerMrQrjrOrIrNrTrVN)__name__ __module__ __qualname____firstlineno__rr\rk__static_attributes__rar^r[rBrBhsN\N$  L  r^rBrDreturnc^[RU5nUc[U5nU[U'U$N) _spec_cachegetrB)rDspecs r[ _get_specrxs. ??4 D |D! D Kr^c[U5nURU5 0n[U5n[UR5HupU[ U5:a[ XU5Xi'M&X;a;XR;a[U S35e[ XRU 55Xi'MfXR;a@URU n Sn U(a [X*5n [ XRU U 5Xi'M[SU 35e U[ UR5Sn UR(a"[ U[U 55XeR'O4U (a-[S[ U5S[ UR535eURHqn X;a[ XRU 55Xi'M&XR ;a0Sn U(a [X)SS9n [ XR U U 5Xi'Me[SU 35e UR"(a[ X5XeR"'U$U(a[S[%U535eU$) Nz is positional-onlyz&Missing required positional argument: z#Too many positional arguments: got z , expected T)is_kwz(Missing required keyword-only argument: zUnexpected keyword arguments: )rxrkrf enumeraterPrhwrap_bound_argrN TypeErrorpoprjr%rcrTtuplerQrerVlist)rDtx fn_sourceargskwargsrwbarem_kwinameidxdefault_sourceextrakwdefault_sources r[bind_args_cachedrs T?D B &\FT//0 s4y=%bq'2BH ^)))4&(; <==%b**T*:;BH )) )&&t,C!N!/ !?%b--*%b**T*:;BH __ $# #1)#N %b//$*?AQRBHFtfMN N" ,R8?? I 8fGHH Ir^c[U[5(aU$U(d[R"X5$[RR X5$rt) isinstancer4buildrLazyVariableTrackercreate)rvalsources r[r|r|sA#'' $$R--,,33C@@r^c[UR55H/up#[U[[45(dM"[ X5X'M1 grt)ritemsrrrfr|)rresultkvs r[wrap_args_kwargsrs6V\\^$ a% ' '&r-FI%r^rcURRnURH<nUR5nXA;a UR XQR U55 XQU'M> g)z Update `result` to add mapping from local name to new cells created directly by `code`, or update SideEffects in `parent` if the a local cell is already in `result` (cell argument). N)output side_effects co_cellvarstrack_cell_new store_cellr~)parentrrXrrnew_cells r[ init_cellvarsrsV ==--L  ..0 >  # #Hjj.> ?t !r^cSSKJn U"XX#U5nXXl[U[5(aSSKJn [U "U55nUb[U[5(deXhlU$)Nrrpairwise) typesrrdrr itertoolsrrf__annotations__) rX f_globalsrrcclosurere annotationsrrDrs r[_create_nested_fnrs_#  AD$+u%%&8K01   *[$"?"?? ?& Kr^>__doc__rF __closure__ __globals__rbrdrc>U=(a [X#5n[R"X5nU[ ;a [ X5nU(a [RRWU5$[R"UW5$![a [ [U5 Nof=frt) r#inspectgetattr_staticAttributeErrorrfn_known_dunder_attrsgetattrrrrr4r)rfnrrsubobjs r[fn_var_getattrrs  0 60F5''1 $$" ,,33FFCC  V ,, 5 !45sA??BBc\\rSrSrSrSrSSjrSSS\S\4S jr S r S r S r g )BaseUserFunctionVariableic6UR5R$rtget_code co_filenamerWs r[ get_filename%BaseUserFunctionVariable.get_filename}}***r^c6UR5R$rtrco_namers r[get_name!BaseUserFunctionVariable.get_name}}&&&r^rr:rrcLURU/UR5QUQU5$rt)inline_user_function_return self_argsrWrrrs r[ call_function&BaseUserFunctionVariable.call_functions, --d4Ndnn6F4N4NPVWWr^rcSn[UR5U5n[ R RU5$![a US:Xa[U[5(aSnNHf=f)NFrmT)hasattr get_functionNotImplementedErrorrNestedUserFunctionVariablerr6rrWrrrs r[call_obj_hasattr)BaseUserFunctionVariable.call_obj_hasattr'sh T..0$7F))0088# z!j7Q&R&R s='A'&A'cp[[R"UR55R5$rt)rr signaturer parametersrs r[inspect_parameter_names0BaseUserFunctionVariable.inspect_parameter_names3s'G%%d&7&7&9:EEFFr^c0$rtrarWrs r[ closure_vars%BaseUserFunctionVariable.closure_vars6 r^raNrr:rlist[VariableTracker]rdict[str, VariableTracker]rrr4) rmrnrorprrrstrr4rrrrqrar^r[rrsd+'X #X&X- X  X 9) 914 9  9Gr^rc^\rSrSrSrSS1\R kr\S5rSSU4Sjjjr U4Sjr S r S r S r S rS rSrS\\\44SjrSSS\4SjrSSS\S\4SjrSU4SjjrSrU=r$)UserFunctionVariablei:z-Some unsupported user-defined global functionr is_constantc^[UR[R55 U"XS9$Nr)r" make_guardr! CLOSURE_MATCHclsvaluers r[create_with_source'UserFunctionVariable.create_with_sourceCs&f'' (B(BCD5((r^rrc R>[TU]"S 0UD6 [USS5(aSUlOSUl[ U[ R [RR45(d[SUSS/[RQS9 [R"USU5nXlg) N_dynamo_marked_constantFTz1can't handle functions not implemented in python z2Dynamo can only handle functions defined in pythonz9Move usage of this function out of `torch.compile` regiongb_typecontext explanationhints_torchdynamo_inlinera)superr\rrrrrtorchjitScriptFunctionrrINFERENCE_MODErrrrWrrr __class__s r[r\UserFunctionVariable.__init__Hs "6" 20% 8 8#D $D "u115993K3KLMM K$PO&55   # #B(=r B&(r^cb>[U[5(a UR$[TU]5$rt)r.rrras_python_constantrWrs r[r'UserFunctionVariable.as_python_constantbs( $, - -77Nw)++r^c/$rtrars r[rUserFunctionVariable.self_argshrr^cUR$rtrrs r[r!UserFunctionVariable.get_functionk wwr^c.URR$rt)rrFrs r[rUserFunctionVariable.get_codenswwr^c"[R$rtrrrs r[ python_type UserFunctionVariable.python_typeq!!!r^c4[URSS5SL$N__self__)rrrs r[has_selfUserFunctionVariable.has_selftstww D1==r^c.URR$rt)rrrs r[ get_globals UserFunctionVariable.get_globalswsww"""r^cnUR(aeURn[U[5(d [ S5eUR R n[XEURX#5n[XUR5 URR=(d Sn[U5[URRR5:Xde[[R "5URRRU5Hupn UR R"n X;aXn OUR(aa[%['URS5U5n ['U S5n[(R*"XR,U5nU R5XU5n O3[(R*"XR,5nU R5SX5n XU 'M U$![.a [0R2"5nNqf=f![.a [0R2"5nNbf=f)z Assume `args` and `kwargs` are VariableTracker arguments for a call to this function, create new bindings for initial locals. z'Only supports regular Python functions.rar cell_contentsN)rrrrr}rroot_txrrrrFrrh co_freevarsrgrcountrr&r#r4rr ValueErrorrDeletedVariabletrack_cell_existing)rWrrrrrrrrrcellrcell_var closure_cellclosure_cell_contents contents_vars r[ bind_argsUserFunctionVariable.bind_argszs ####!%"l++EF F--''!"t{{DIfbkk2''%%+7|s477#3#3#?#?@@@@" OO tww//;;W OCt"==55L#'-,t{{M:C  )3<(Q%?#2#8#8 2 24I$L (;; ?#2#8#8ASAS#TL(;;D$U#4LE H '"?#,#<#<#>L?"?#,#<#<#>L?s$UR[RRLaUVs/sHoDR 5PM nnUR 5VVs0sHupgXgR 5_M nnn[RR"U0UD6R n [R"U 5$UR[RRLGa[R"UR5R"U0UD6n U RSn [!U ["5(dPU R%5n SU R&S3n[)SSUR*SUSUS 3U/[,R.QS 9 [!U [05(d)U R35nS US 3n[)S UUSUS3S/S 9 U Rn[R4"USS9$UR6(a%[9XRUR35X#5$UR:R<R>(dtUR[RR@RBLaC[RRDRGU5 [HTU]XU5sSSS5 $UR:R<RL(aUR:R<RN(dsSSK(J)n UbiURURVURX4;aC[RRDROU5 [HTU]XU5sSSS5 $[HTU]XU5$s snfs snnf![an [SUSU35U eSn A ff=f!,(df  GN =f![Ta SnNf=f!,(df  Nq=f)NzCannot convert patch_dynamo_config args/kwargs to constants. Please fix your call to patch_dynamo_config by using simpler inputs. args: z , kwargs: rz=`nonstrict_trace` expects a callable, but got value of type <>zTypeError from user codezcall_function(, )rz(Applying `nonstrict_trace` to function ; however, `nonstrict_trace` currently requires the function to be defined outside `torch.compile` region.zLimitation of `nonstrict_tracezmake sure definition of z is outside z`torch.compile` regionTnonstrict_traceable) FSDPState)-rr_dynamopatch_dynamo_configrrchangesrDynamoConfigPatchVariabler1 RuntimeErrornonstrict_tracerrbindrrrrrmrrr USER_ERRORrrTorchInGraphFunctionVariablerinvoke_and_store_as_constantrcurrent_tracer,unsafe_allow_externally_visible_side_effectsutils8_disable_side_effect_safety_checks_for_current_subtracerr2allow_externally_visible_side_effects_in_subtracerrrunder_activation_checkpoint#allow_side_effects_under_checkpoint/torch.distributed.fsdp._fully_shard._fsdp_stater8 Exception _pre_forward _post_forward)rWrrrarg args_constkeyr kwargs_constr;er>fn_vartypmsgfn_namerr8rs r[r"UserFunctionVariable.call_functions{ 77emm77 7 BFG$3446$ GBH,,. BPhcC//11.  --;;#/'!::7CC 77emm33 3%%dgg.33TDVDEZZ]Ff&>??((*UVYVbVbUccde 6,TZZL4&6(!L #*55 f&:;; //+@ Juv <#f #27)<H0 B99"RVW W   /GGT]]_d   ((UU}}""[[\++^^w,Rv> II $ $ @ @II,,PP !U$&&''5*]]//SSTVW 706BXWw$Rv66WH 7 "!F*VH6  ` !  ! XWs_N NN N8AN N1OO N N.N))N.1 O OO O#)rrFrrNr)rmrnrorprr_nonvar_fields classmethodrr\rrrrrrrrfrr4r)r.rrrq __classcell__rs@r[rr:s7  " 0 0N ))))4,  ">#5c?6J1K5n>5>S> 9)9149 9 U7 #U7&U7- U7  U7U7r^rcZ^\rSrSrSSU4Sjjjr\S5rSSjrSrU=r $) BuiltinMethodVariableic t>[TU]"S0UD6 [U[R5(deXlgr`)rr\rrBuiltinMethodTyperrs r[r\BuiltinMethodVariable.__init__s1 "6""e556666r^cURnURnU[L=(a US:H=(d [U5[L=(a US:H$)N__new__ __contains__)rrmrtype frozenset)obj method_self method_names r[is_supported_builtin_method1BuiltinMethodVariable.is_supported_builtin_methodsIll ll u$A )A   * L{n/L r^cURRnURRnUR=(a [ URS5n[ R "XU5nURXX#5$r)rrrmrr#r4r call_method)rWrrrrir obj_sourceobj_vts r[r#BuiltinMethodVariable.call_function%s` gg&& ww[[HZ Z%H  &&r C!!"D99r^r rXrYr) rmrnrorpr\ staticmethodrkrrqr\r]s@r[r_r_sQ    : # :& :- :  : :r^r_c ^\rSrSrS\R S\S4U4SjjrSrSr Sr S r S r S rS r \ rS$S jrSrSrSrSrSrSrS\R.4SjrS\\4SjrS%SjrSrSrSrSSS\ SSSS SS!4 U4S"jjr!S#r"U=r#$)&LocalGeneratorObjectVariablei2rX inline_tracerr:c J>[TU]"S0UD6 XlX lX0lgr`)rr\rXrru)rWrXrrurrs r[r\%LocalGeneratorObjectVariable.__init__3s% "6" "*r^cUR$rt)rXrs r[r%LocalGeneratorObjectVariable.get_code?s yyr^c6UR5R$rtrrs r[r)LocalGeneratorObjectVariable.get_filenameBrr^c6UR5R$rtrrs r[r%LocalGeneratorObjectVariable.get_nameErr^c[ert)rrs r[r)LocalGeneratorObjectVariable.get_functionHs!!r^cgNFrars r[r%LocalGeneratorObjectVariable.has_selfKr^c"UR5$rt)rrs r[rm%LocalGeneratorObjectVariable.__name__Ns}}r^cVURRSUR5S3$)N(r5)rrmrrs r[__str__$LocalGeneratorObjectVariable.__str__Qs'..))*!DMMO+>r^cSSKJn SSKJnJnJn UR "5nU"U5nU"U5nU"U5n U U U  URU5n U R(dURU5Ul [R"UR5RU5 SSS5 SSS5 SSS5 g!,(df  N=f!,(df  N(=f!,(df  g=f)Nr)"disallow_side_effects_in_generator)r: save_and_restart_speculation_log(temporarely_allow_writes_to_output_graph)torch._dynamo.side_effectsrtorch._dynamo.symbolic_convertr:rr current_tx_get_inline_tracergenerator_exhaustedforce_unpack_var_sequenceremaining_itemsrListIteratorVariable reconstruct) rWcodegenrr:rrrsavedisallowtemptracers r[r(LocalGeneratorObjectVariable.reconstructVsQ  # - - //35b97; 8T,,R0F--'+'E'Eb'I$  * *4+?+? @ L LW U "8TTTT88TTs;C%CA(C*C2C% C C C" C%% C3c:URRXU5$rt)rr)rs r[r)&LocalGeneratorObjectVariable.bind_argsisww  622r^cUR$rtrrs r[r(LocalGeneratorObjectVariable.get_globalsl ~~r^c"[R$rt)r GeneratorTypers r[r(LocalGeneratorObjectVariable.python_typeos"""r^cpSSKJn URcURX/05UlUR$Nr)InliningInstructionTranslator)rrrubuild_inline_tracer)rWrrs r[r/LocalGeneratorObjectVariable._get_inline_tracerrs9P    %!>!R!R"b"D !!!r^cURU5nUR5(a[[U5 [R "[ S[ S05 UR5sSSS5 [ S==[ S-ss'$!,(df  Os=f![anSUl UeSnAf[a e[aCn[RRRUR!55 ["UeSnAff=f[ S==[ S-ss'g![ S==[ S-ss'f=f)N unimplemented inline_callT)r_is_generator_exhaustedr StopIterationr rfr* inline_call_rrrr rr9 eval_frame skip_coderr)rWrrrRs r[ next_variable*LocalGeneratorObjectVariable.next_variable{s ((,  ' ' ) ) $]B 7 AH8O&PQ**,RQ _ %-)@ @ %RQ  )-F &G%   # MM $ $ . .t}} ? " #R _ %-)@ @ %H_ %-)@ @ %sS$BB, B BBD)B D ) B22D  >DD  D))Ecgrrars r[has_unpack_var_sequence4LocalGeneratorObjectVariable.has_unpack_var_sequencerr^rrcgNTrars r[has_force_unpack_var_sequence:LocalGeneratorObjectVariable.has_force_unpack_var_sequencesr^c@/nURXR5 U$rt)force_apply_to_var_sequenceappend)rWrrs r[r6LocalGeneratorObjectVariable.force_unpack_var_sequences ((]]; r^cnU"URU55 M![a [U5 gf=frt)rrr)rWrrs r[r8LocalGeneratorObjectVariable.force_apply_to_var_sequences> 4%%b)*- )"- s 44cURU5nURU5 g![anURU5 SnAgSnAff=frt)r_raise_exception_variablerexception_handler)rWrexcrrRs r[_setup_exception-LocalGeneratorObjectVariable._setup_exceptionsH((, (  , ,S 1  (  $ $Q ' ' (s% A AA c^URSL=(d URRS:H$)Nr)ruinstruction_pointerrs r[_is_generator_just_started7LocalGeneratorObjectVariable._is_generator_just_starteds*!!T)XT-?-?-S-SWX-XXr^c0[URSS5$)NrF)rrurs r[r4LocalGeneratorObjectVariable._is_generator_exhaustedst))+@%HHr^rrrrrrr4c>US:XaURU5$US:XaU$US:XaUR5(a7[U5(a'[SU55(d[ [ U5 UR U5nURU5 URU5$US:XaUR U5nUR5(dUR5(aSUl [R"S5$URU[R"[S55 [R S:a7UR"R$S :XaSUl [R"S5$URU5(a[ [(U5 OUS :XaUR U5nURU[U5S :XaUS OUS 5 URU5n[1S[2405nURU[R"US55 URU5 [ [(U5 U$[6TU]qXX45 g![&a SUl [R"S5s$f=f![&a SUl [R"S5s$[*a UR,ceUR,s$f=f![.a ef=f![5U5a U$f=f)N__next____iter__sendc3l# UH*n[U[5=(a URSLv M, g7frt)rr6r).0rNs r[ ;LocalGeneratorObjectVariable.call_method..s0#s$45K#))t:KK#s24closeTra) CALL_INTRINSIC_1throwrr0r__InternalThrowException)rrrhallrr}r push_manyrrrr6rExceptionVariable GeneratorExitsys version_infonext_instructionopnamerr=rsymbolic_resultrrfrKrrrn) rWrrrrrretvalexc_typers r[rn(LocalGeneratorObjectVariable.call_methods : %%b) ) Z K V^..00SYY#-Y;,,R0F   T "%%b) ) W_,,R0F..00D4P4P4R4R-1* 11$77 8%% 33M2F($$///66:LL15F.$55d;; .%%b)),\2>W_,,R0F  %%bSY!^$q'aQ ''+F|6 bIH ?%%b)*E*EhPR*ST""2& )v>M Bd3a) 8-1* 11$77 8) 8-1* 11$77, . --999---  .,%  N1: M  sIA5I#<&J;)K#8K2#'J  J 'K 9$K K # K/2LL)rXrrurrr8rY)$rmrnrorprCodeTyperr\rrrrrr__repr__rr)rrrrrbuiltinsboolrrr4rrrrrrrnrqr\r]s@r[rtrt2s +nn + 78 ++'"?HV&3#"A08==tO/D (YIz4 #z4z4& z4 - z4  z4z4r^rtc\rSrSrSrSrg)4ContextlibContextManagerLocalGeneratorObjectVariableirz .. note:: This is only used when the function is annotated with @contextlib.contextmanager It is a special case of a generator function as we do not allow return a context manager from a torch.compile function. raN)rmrnrorprrqrar^r[rrrsr^rcb^\rSrSrSr\S.S\4U4SjjjrSrSr S Sjr S r U=r $) LocalGeneratorFunctionVariableizlfunctions that behaves like iterators .. note:: This is a wrapper around (Nested)UserFunctionVariable ) generator_clsvtc >>[TU]"S0UD6 XlX lgr`)rr\rr)rWrrrrs r[r\'LocalGeneratorFunctionVariable.__init__s  "6"*r^cXRRR5;a [X5$[URU5$rt)r__dict__keysrr)rWrs r[ __getattr__*LocalGeneratorFunctionVariable.__getattr__s7 >>**//1 14& &tww%%r^c6SSKJn URUUUU5$r)rrr)rWrrrrs r[_build_inline_tracer3LocalGeneratorFunctionVariable._build_inline_tracers$P,@@       r^c[URR55(deURXU5nURR5nURR 5nUR UUUUR S9$r)rrrrrrr)rWrrrrurXrs r[r,LocalGeneratorFunctionVariable.call_functions DGG,,.////11"FC ww!GG'') !!   ;; "  r^)rrr) rmrnrorprrtr4r\rrrrqr\r]s@r[rrsY3 +  + +&   # & -     r^rc8^\rSrSrSrU4SjrU4SjrSrU=r$)3FunctionDecoratedByContextlibContextManagerVariableiza .. note:: This is only used when the function is annotated with @contextlib.contextmanager c 4>[TU]"U4S[0UD6 g)Nr)rr\r)rWrrrs r[r\[TU]XU5n[U[RR R 5(deSUlU$r)rrrrr9symbolic_convert&InliningGeneratorInstructionTranslatoris_generator_from_ctx_manager)rWrrrrrs r[rHFunctionDecoratedByContextlibContextManagerVariable._build_inline_tracersR -b?  MM * * Q Q    04, r^ra) rmrnrorprr\rrqr\r]s@r[rrs    r^rc^\rSrSrSrSU4SjjrS\4SjrSrSr SU4S jjr U4S jr SS S \4U4S jjr Sr U=r$)UserMethodVariableiz$Some unsupported user-defined methodrrc 6>[TU]"SSU0UD6 X lg)Nrrarr\rh)rWrrhrrs r[r\UserMethodVariable.__init__s )B)&)r^chURRSURSURS3$)Nrr4r5)rrmrrhrs r[rUserMethodVariable.__repr__s...))*!DGG9BtxxjBBr^cUR/$rtrhrs r[rUserMethodVariable.self_argszr^c"[R$rt)r MethodTypers r[rUserMethodVariable.python_typesr^rr:c>SSKJn U"UR5(aE/UR5QUQn[R "URSS9nUR XU5$URR5(a[UR[R5(a[URSS5nUbURS5(aUS:wdUR(a9URRXRR X#URS 9$Ol["beUR["R$R&La>[R("UR5R XR/UQ7U5$UR(aO[URR*URR 5n[-XUR/5X#5$[0T U]XU5$) Nr)is_nonstrict_trace_callableTr6rnz torch.nn.ztorch.nn.utils.parametrize)constant) trace_rulesrrrrrArris_root_tracerrrhNNModuleVariabler startswithrrnrmr7FSDPParamGroupuse_training_stateTorchCtxManagerClassVariablerrBrr) rWrrrr call_argsvar module_attrrrs r[r UserMethodVariable.call_functions > &tww / /2$..*2T2I88TC$$RF; ; 99 # # % %* HHi00+ + "$''<[TU]5SS$Nr0)rrrs r[r*UserMethodVariable.inspect_parameter_names!sw.044r^rc>UR=(a [URU5nUS:Xa UR$US:Xa![R"XR U5$[ TU]X5$)Nr__func__)rr#rhr4rrrr.)rWrrrrs r[r.UserMethodVariable.var_getattr$s\>DKK!> : 88O : "((WWf= =w"2,,r^rrYr)rmrnrorprr\rrrrrrr.rqr\r]s@r[r r sm.C#C ;7 #;7&;7- ;7  ;7z5-5-S--r^r cR^\rSrSrSU4SjjrSU4SjjrSrSrU=r$)WrappedUserMethodVariablei-c >URSS5 URSS5 [TU]"URUR40UD6 XlX lg)Nrrh)r~rr\rrhwrappedrrWr.rrrs r[r\"WrappedUserMethodVariable.__init__.sE 4 5$ W[[;F;  r^c>URRU5 [TU] XU5nURR U5 U$rtrenterrrexitrWrrrrrs r[r'WrappedUserMethodVariable.call_function5? 2&r8 " r^c^^TRUU4Sj5 T"TR5 TR[SS55 g)Nc(>T"TR5$rtrrrWsr[7WrappedUserMethodVariable.reconstruct..Agdll&;r^r0F add_push_nullr. extend_outputrrWrs``r[r%WrappedUserMethodVariable.reconstruct@4;< 21e<=r^rr.rYr rmrnrorpr\rrrqr\r]s@r[r,r,-=  # & -   >>r^r,cR^\rSrSrSU4SjjrSU4SjjrSrSrU=r$)WrappedUserFunctionVariableiFc x>URSS5 [TU]"UR40UD6 XlX lg)Nr)r~rr\rr.rr/s r[r\$WrappedUserFunctionVariable.__init__Gs1 4 .v.  r^c>URRU5 [TU] XU5nURR U5 U$rtr2r5s r[r)WrappedUserFunctionVariable.call_functionMr7r^c^^TRUU4Sj5 T"TR5 TR[SS55 g)Nc(>T"TR5$rtr:r;sr[r<9WrappedUserFunctionVariable.reconstruct..Yr>r^r0Fr?rBs``r[r'WrappedUserFunctionVariable.reconstructXrDr^rErYrrFr]s@r[rIrIFs=  # & -   >>r^rIcSnUVs/sH oe"U5PM nnUR5VVs0sH upxXu"U5_M nnnU"U0UD6n URRU U[U5S9$s snfs snnf)Nc[U[R5(aUR5$UR 5$rt)rrTensorVariableget_real_valuer)xs r[convert-invoke_and_store_as_constant..convert_s3 a11 2 2##% %##%%r^r)rrregister_attr_or_moduler$) rrrrrrWrVrrress r[rBrB^s& !% %1GAJD %(.  7amF 7 d f C 99 , ,  d# -  & 7s A1A6c^\rSrSrS1\R krSSU4SjjjrSrSrSr Sr SS S \ S \ 4S jr U4S jr SrU4SjrSrSrSrSSjrSrU=r$)rinrc  >U RS5cU R[5S9 [T U]"S0U D6 [ UR 5[5(de[ UR 5[R5(de[ U[5(deXl X l X0l X@lXPlX`lXplXlg)N mutation_typer]ra)rvupdater2rr\rrrrrrfrVrXrrcrerr wrapped_fn) rWrVrXrrcrerrr`rrs r[r\#NestedUserFunctionVariable.__init__ts ::o & . MM(<(>M ? "6"'446<<<<$113U^^DDDD)T****  " $& 5?r^c/$rtrars r[r$NestedUserFunctionVariable.self_argsrr^c6URR5$rt)rXrrs r[r#NestedUserFunctionVariable.get_codesyy++--r^c"[R$rtrrs r[r&NestedUserFunctionVariable.python_typerr^cUR(a[e[R"URR 5UR URR 55nUR(aURR 5Ul UR(aURR 5Ul UR(acURR 5n[U[5(aSSKJn [#U"U55n[U["5(deX!lU$)Nrr)rrrrrXrrrVrcrbrerdrrrrrrfr)rWrDrrs r[r'NestedUserFunctionVariable.get_functions <<% %!! II ( ( * NN LL + + -  == $ @ @ BD  ??"&//"D"D"FD    **==?K+u--."8K#89 k400 00#.  r^rr:name_varrcxURRRXRU5 [ S5$rt)rr store_attrrr6)rWrrjrs r[ call_setattr'NestedUserFunctionVariable.call_setattrs- ))$D%%r^cV>US:XaUR"U/UQ76$[TU] XX45$)N __setattr__)rmrrnrWrrrrrs r[rn&NestedUserFunctionVariable.call_methods3 = $$R/$/ /w"2T::r^cURSL$rt)rrs r[ has_closure&NestedUserFunctionVariable.has_closures||4''r^cb>US:XaURR5$[TU] X5$)Nrm)rVrr const_getattr)rWrrrs r[rw(NestedUserFunctionVariable.const_getattrs. : <<224 4w$R..r^cgrrars r[r#NestedUserFunctionVariable.has_selfrr^cUR$rtrrs r[r&NestedUserFunctionVariable.get_globalsrr^c`UR5n[R"UURURR 5UR (a[UR R5OS[S[[UR5R55555nUR(aURR5Ul[R "U5R""U0UD6nUR%5 ['UR(R55n[+UR,R.U5 [1XU5 [3UR5H)upX;deUR4RUn XU 'M+ U$)Nc38# UHn[S5v M g7frt)r/)r_s r[r7NestedUserFunctionVariable.bind_args..sS+Ra)D//+Rs)rrrrrVrrcrrrirhrrekeys_as_python_constantrdrrr?apply_defaultsrf argumentsrrrrr{r) rWrrrrXrDr>rrrr$s r[r)$NestedUserFunctionVariable.bind_argss9}}!!  NN LL + + -*.--E$--%% &T S5T]]_5P5P1Q+RS S   ??"&//"I"I"KD !!$',,d=f= eoo++-...7fd+"4#3#34IC% %%<<%%c*D4L5  r^c^TRU4Sj5 T"UR5 TRTRUR5/5 T"[ R "URRR55 UR(aT"UR5 O!TRTRS5/5 UR(aT"UR5 O!TRTRS5/5 UR(aT"UR5 O!TRTRS5/5 UR(a=URR5nTRTRU5/5 O!TRTRS5/5 TR[!SS55 UR"(awTRU4Sj5 T"UR"5 TR[!SS55 TR[%S55 TR[!SS55 SS KJn UR*"5nUR,R.R1U5(a~UR,R.R2UR55HHupVTR75 T"U5 TR[%S55 TR9U5 MJ gg![a T"UR5 GNf=f) Nc0>TR[S5$)Nr)load_import_fromrmrsr[r<8NestedUserFunctionVariable.reconstruct..sG,,X7JKr^Fc(>TRSS5$)N functoolswrapsrrsr[r<r s00gFr^r0rTrr9)r@rXrAcreate_load_const_uncheckedrr6rrrrccreate_load_constrrerrrrr`rrr:rrrhas_pending_mutationstore_attr_mutationsrdup_toprl)rWrrr:rrrs ` r[r&NestedUserFunctionVariable.reconstructs K   wBB4>>RST '' (?(?@A == DMM "  ! !7#<#URSS5 URSS5 URSS5 URSS5 URSS5 URSS5 URSS5 URSS5 [TU] URURUR UR URURURUR5 Xl X l g) NrVrXrrcrerrr`) r~rr\rVrXrrcrerrr`r.rr/s r[r\*WrappedNestedUserFunctionVariable.__init__"s 9d# 64  ;% :t$ <& =$' 9d# <&  OO LL             OO      r^c>URRU5 [TU] XU5nURR U5 U$rtr2r5s r[r/WrappedNestedUserFunctionVariable.call_function8r7r^c^^TRUU4Sj5 T"TR5 TR[SS55 g)Nc(>T"TR5$rtr:r;sr[r<?WrappedNestedUserFunctionVariable.reconstruct..Dr>r^r0Fr?rBs``r[r-WrappedNestedUserFunctionVariable.reconstructCrDr^rErYrrFr]s@r[rr!s=,  # & -   >>r^rc^\rSrSrSS1\R krSSU4SjjjrSr\S5r SS jr SS jr SSS \ 4S jr S rU=r$)SkipFunctionVariableiIrreasonc >>[TU]"S0UD6 XlX lgr`)rr\rr)rWrrrrs r[r\SkipFunctionVariable.__init__Ps "6"  r^cUR$rtrrs r[r'SkipFunctionVariable.as_python_constantUs zzr^c~[U5(d([UR[R55 U"XS9$r)r-r"rr!FUNCTION_MATCHrs r[r'SkipFunctionVariable.create_with_sourceXs3.u55 &++L,G,GH I5((r^rr:c n[R"URSS5(aT[R"URSS5n[S[ UR5SURSUS3S/S 9 gUR[ R RLaAURS S5nU(aUR5n[S S US US3SU3S/S 9 gUR[ R RLa7URS S5nU(aUR5n[SU35e[R(aHSSKJn UR!XR5n[#U[$5(dUR'XU5$[)URSS5n [)URSS5n U cSO [ U 5n [R*"UR5n SU SU S3n SU S3/nSU ;a USU S3S /- nU S/:XaS0n /nUR6(a UR6OS1n[S2S3U S4U S5U3U US 9 g![,a S!S"1nX;aS#U S$U S3n S%S&/nNaU bbU R/S'5(aLS(U S$U S$3n S)/n[ R R0R3U S*-S*R5U5-5 NS+U S$U S,3n S-S./n[ R R0R3U S*-S*R5U5-5 GNf=f)6N_torchdynamo_disableF_torchdynamo_disable_msgz1Skip calling `torch.compiler.disable()`d functionzSkip calling function `z>` since it was wrapped with `torch.compiler.disable` (reason: r5z(Remove the `torch.compiler.disable` callrrUz%Call to `torch._dynamo.graph_break()`z0Called `torch._dynamo.graph_break()` with args `z `, kwargs ``z$User-inserted graph break. Message: z.Remove the `torch._dynamo.graph_break()` call.z9Skip frame due to `torch._dynamo.skip_frame()`. Message: r0SourcelessBuilderrozrnzz?Dynamo developers have intentionally marked that the function `z ` in file `z` should not be traced.zAvoid calling the function `z`.r9z:Apply `@torch._dynamo.dont_skip_tracing` to the function `zw` to force tracing into the function. More graph breaks may occur as a result of attempting to trace into the function.z Please file an issue to PyTorch._abc _warningsz6Dynamo does not know how to trace the Python builtin `.zIf you are attempting to call a logging function (e.g. `_warnings.warn`), you can try adding it to `torch._dynamo.config.reorderable_logging_functions`.zKPlease file an issue on GitHub so the PyTorch team can add support for it. optreez*Dynamo cannot trace optree C/C++ function zi Consider using torch.utils._pytree - https://github.com/pytorch/pytorch/blob/main/torch/utils/_pytree.py z/Dynamo does not know how to trace the builtin `z.` This function is either a Python builtin (e.g. _warnings.warn) or a third-party C/C++ Python extension (perhaps created with pybind).zIf it is a Python builtin, please file an issue on GitHub so the PyTorch team can add support for it and see the next case for a workaround.aIf it is a third-party C/C++ Python extension, please either wrap it into a PyTorch-understood custom operator (see https://pytorch.org/tutorials/advanced/custom_ops_landing_page.html for more details) or, if it is traceable, use `torch.compiler.allow_in_graph`.allow_in_graphzFound an allow_in_graph decorator to a function which is created inside the parent function that is getting compiled. This is not supported for now.zz,Attempted to call function marked as skippedzmodule: z , qualname: z, skip reason: )rrrrrrr9 graph_breakrvr skip_framerrdont_skip_tracingbuilderrrrrrrgetfiler}rrE warn_oncejoinr)rWrrrrUgraph_break_msgskip_frame_msgr rebuilt_fnqualname module_or module_namepathrrknown_python_builtin_modulesrs r[r"SkipFunctionVariable.call_functionas  ! !$**.De L L((5OQUVC KDJJ5djj\B::=aA?  ZZ5==44 4$jj5O"1"D"D"F ?J4&P[\b[ccdeB?BSTD  ZZ5==33 3#ZZt4N!/!B!B!DKNK[\ ''6/55b**E !*.BCC%33BfEEtzz>;OPH L$?I090A,s9~K8 Ytzz2UV^U_` $v%<> 38*B? D(TU]T^_ll; EX++? $(KKT[[5GF F";-|H:_U[T\]'  ]% Y06 /D,<'=(27 iGE *y/C/CH/M/M$N{m[\]e\ffg"hK^E MM''11+2DtyyQVGW2WXJ+VWX`Wabab m;EMM''11+2DtyyQVGW2WXK% Ys!AI L4A#L4%A L43L4ch[RR[URU55$rt)rr6rrrr-s r[r%SkipFunctionVariable.call_obj_hasattrs$))00T1JKKr^rcU[;a[R"X5$[XRUR U5$rt)r)rr,rrrr-s r[r. SkipFunctionVariable.var_getattrs3 ) ),,T8 8b**dkk4@@r^)rrrtrYrrr:)rmrnrorpr4rZr\rr[rrrrr.rqr\r]s@r[rrIs  ' 'N  ))v #v&v- v  vpLA5ASAAr^rcR^\rSrSrSU4SjjrSU4SjjrSrSrU=r$)WrappedSkipFunctionVariableic >URSS5 URSS5 [TU]"UR4SUR0UD6 XlX lg)Nrr)r~rr\rrr.rr/s r[r\$WrappedSkipFunctionVariable.__init__sH 7D! 8T" Hw~~HH  r^c>URRU5 [TU] XU5nURR U5 U$rtr2r5s r[r)WrappedSkipFunctionVariable.call_functionr7r^c^^TRUU4Sj5 T"TR5 TR[SS55 g)Nc(>T"TR5$rtr:r;sr[r<9WrappedSkipFunctionVariable.reconstruct..r>r^r0Fr?rBs``r[r'WrappedSkipFunctionVariable.reconstructrDr^rErYrrFr]s@r[rrrGr^rc`^\rSrSrSrSU4SjjrS U4SjjrSrS SjrSr U=r $) WrapperUserFunctionVariableia Used to represent a wrapper object that contains the actual callable as an attribute. For example, torch.jit.script/trace have the original function at their _torchdynamo_inline attribute. Similarly, functions with __script_if_tracing_wrapper have the original attr at "__original_fn". c >>[TU]"S0UD6 XlX lgr`)rr\ wrapper_obj attr_to_trace)rWrrrrs r[r\$WrapperUserFunctionVariable.__init__s "6"&*r^c>X R:Xa`[URUR5nUR=(a [ URU5n[ R "XU5$[TU]!X5$rt) rrrrr#r4rrr.)rWrrrrrs r[r.'WrapperUserFunctionVariable.var_getattr sc %% %$**D,>,>?C[[BZ T%BF"((&9 9w"2,,r^c/$rtrars r[r%WrapperUserFunctionVariable.self_argsrr^c[URS5(Gaw[URURS5n[USS5=(d SnUR SSS9SS:wGa(S n[ R RRU5 [ R RRRS 5nUR[R5(a[ RRR5n[!5U-nUS R"US R$4n SR'[(R*"U55n S U SS U SS3n U [-U 5- n UR/U 5 UR15U-n [2R4"[6R85R;UU[2R<"UR5/U QU5$)N cache_infornrrr0)maxsplitrraDynamo detected a call to a `functools.lru_cache`-wrapped function. Dynamo ignores the cache wrapper and directly traces the wrapped function. Silent incorrectness is only a *potential* risk, not something we have observed. Enable TORCH_LOGS="+dynamo" for a DEBUG stack trace.z torch._dynamoz)call to a lru_cache wrapped function at: :r)rrrrsplitrr9rErlogging getLogger isEnabledForDEBUG_guardsTracingContext extract_stackrfilenamelinenor traceback format_listrdebugrrrrgetattr_and_tracerr6) rWrrr target_fnrrU dynamo_logger user_stack frame_locuser_stack_formatteduser_stack_traceall_argss r[r)WrapperUserFunctionVariable.call_functions 4##\ 2 2 0 0$2D2DdKI!)\2>D"K  q 1!4?K ##--c2 % 3 3 ; ; E Eo V  --gmm<>#d*--  ' ' -  9--d.@.@A MH M   r^)rrrYrr) rmrnrorprr\r.rrrqr\r]s@r[rrsG+ -& #& && - &  & & r^rc6^\rSrSrSrSU4SjjrSrSrU=r$)WrapperUserMethodVariablei=z Similar to WrapperUserFunctionVariable, but for methods. The only delta is saving the vt for `self` object of the method which is then used by WrapperUserFunctionVariable in `call_function` method. c 4>[TU]"X40UD6 X0lgrtr )rWrrself_objrrs r[r\"WrapperUserMethodVariable.__init__Ds >v>r^cUR/$rtrrs r[r#WrapperUserMethodVariable.self_argsHrr^rrY) rmrnrorprr\rrqr\r]s@r[rr=s r^rc\[RR5(aSSKJn U$0$)Nrtraceable_collective_remaps)r distributed is_available)torch.distributed._functional_collectivesrrs r[_traceable_collective_remapsrLs) %%'' +* Ir^c[RR5(dS5eU[5R 5;deUR nUR S5n[X25$)NzIllegal invocation.z)torch.distributed._functional_collectives)rrrrvaluesrm import_sourcer#)rr inner_name path_sources r[_traceable_collectives_sourcer Wsc    ) ) + +B-BB + -/668 88 8J""#NOK k ..r^c^\rSrSrSrS U4Sjjr\S Sj5r\S5r\S Sj5r S Sjr Sr U=r $) !CollectiveFunctionRewriteVariablei`a Some of the torch.distributed.* collective APIs are possible to rewrite to 'traceable' collectives. This class provides both a way to check if a function is remappable, and perform the remapping. In the case that a function is 'remappable' but only for some combinations of call-time arguments, we check the args at `call_function` time and fall back to graph-breaking if needed. This is no worse than status-quo as we currently graph-break on all distributed.* collectives. c b>[TU]"U40UD6 [U[5(deX lgrt)rr\rrreplacement_var)rWrrrrs r[r\*CollectiveFunctionRewriteVariable.__init__ks/ &v&/+?@@@@.r^c f[RX5upE[U4[U4SU0UD6US.UD6$)Nr)rr)rrewriter)rold_fnroptionsnew_fn new_sources r[r(CollectiveFunctionRewriteVariable.createpsI>FFrR0  0V VgV    r^cV[R"U5=(a U[5;$rt)r isfunctionr)variables r[ can_rewrite-CollectiveFunctionRewriteVariable.can_rewritezs%   x ( WX9U9W-W r^c6[5UnU[X54$rt)rr )rrrs r[r)CollectiveFunctionRewriteVariable.rewrites -/34R@@@r^cSSKJn SSKJn [R "UR 5n[UR"U0UD6R5nSnSU;aUUSR5(a=[SUR SU<SU<3SUR 3/[RQS 9 UR URURUR 4;apUR#S 5nUb UR$OUR&S R(nX;a[+S U35e[,R.R1XX5US 'UR2R5XU5$) Nr)REDUCE_OP_TO_STRraasync_opz)async_op=True for distributed collectivesz, args= , kwargs=z3`torch.compile` doesn't support `async_op=True for ropzUnsupported all_reduce op: )torch.distributedrrr"rrrrfr?rrrr SUPPORTABLE all_reducereduce_scatter_tensor_reduce_scatter_baservrrdefaultr!rr6rrr) rWrrrdistr"r reduce_op_var reduce_ops r[r/CollectiveFunctionRewriteVariable.call_functionsd )N%%dgg. innd5f5??@  F:$6$I$I$K$K C77)8dWJvi8QRVRYRYQZ[&22   77 OO  & &  % %  #JJt,M!,##))$/77  0 #>yk!JKK$55<< +F4L##11"FCCr^)rrYrr) rmrnrorprr\rrrrrrrqr\r]s@r[rr`s/     AA,D #,D&,D- ,D  ,D,Dr^rc<^\rSrSrSU4SjjrSrU=r$)FunctoolsWrapsVariableic>^U(d+[T5S:XaU4Sjn[R"U5$[TU]UTU5$)Nr0c>[U[R5(aURTSS9$[ SUS/[ R QS9 g)Nr)r`zfunctools.wrapsz]`torch.compile` can't trace `functools.wraps` on functions defined outside the compile regionr)rrrclonerrr')rrs r[r3FunctoolsWrapsVariable.call_function..wrapssQb)"F"FGG88tAw877 -!d *66 r^)rhrLambdaVariablerr)rWrrrrrs ` r[r$FunctoolsWrapsVariable.call_functions> #d)q. ++E2 2w$Rv66r^rar)rmrnrorprrqr\r]s@r[r1r1s37 #7&7- 7  77r^r1c4\rSrSrSrSSjrSrg)CollectionsNamedTupleFunctionicUR$rtr rs r[r0CollectionsNamedTupleFunction.as_python_constantr r^c [X#5nU(a~UR"UVs/sHoUR5PM sn0UR5VVs0sHupgXgR5_M snnD6n[R "U[ 5S9$[SSU<SU<3S/[RQS9 gs snfs snnf)Nr^znamedtuple constructionzargs=r$z?`torch.compile` only support certain input types for namedtupler) r'rrrrUserDefinedClassVariabler3rrr') rWrrr constant_argsrVrrrs r[r+CollectionsNamedTupleFunction.call_functions ,D9 GG267$Q&&($79?H1**,,HE55%5%7  -tgZy)Y"..  8Hs B6B;raNr)rmrnrorprrrqrar^r[r9r9s2 # & -    r^r9c^\rSrSrS\SS4U4SjjrSrSSjrSrSS jr S S S \ S\4S jr S S S \ 4Sjr Sr SrSrU=r$)FunctoolsPartialVariableirDrrNc >[TU]"S0UD6 Xl[U[5(deX l[U[ 5(deX0l[R"[5Ul gr`) rr\rDrrrrfkeywordsrpartialr+ fake_value)rWrDrrCrrs r[r\!FunctoolsPartialVariable.__init__s\ "6" $%%%% (D)))) $++H5r^c"[R$rt)rrDrs r[r$FunctoolsPartialVariable.python_types   r^cR^TRU4Sj5 T"UR5 UR(aTRUR5 UR(d2TR [ [UR5S-S55 gTRURR55 [URR55nTR TR[U5[UR5-S-US55 g)Nc(>TRSS5$)NrrDrrsr[r<6FunctoolsPartialVariable.reconstruct..sg&>&>{I&Vr^r0F) r@rDrforeachrCrArrhr rrcreate_call_function_kw)rWrrs ` r[r$FunctoolsPartialVariable.reconstructsVW  99 OODII &}}  ! !"6s499~7I5"Q R  ,,./T]]'')*  + +CIDII,F,JDRW X r^c"UR5$rtrrs r[r%FunctoolsPartialVariable.get_function &&((r^rr:cxURU-n0UREUEnURRXU5$rt)rrCrDr)rWrrr merged_args merged_kwargss r[r&FunctoolsPartialVariable.call_function s< ii$& 34==3F3 yy&&r FFr^rc[RR[[R "[ 5U55$rt)rr6rrrrDr+r-s r[r)FunctoolsPartialVariable.call_obj_hasattrs2))00 I%%h/ 6  r^cUR=(a [URU5nUS:Xa UR$US:Xa[R"UR US9$US:XaWUR R5VVs0sHupE[R"U5U_M nnn[R"XcS9$U[;a[R"X5$[[U5 gs snnf)NrDrrrC)rr#rDr ListVariablerrCrr6rConstDictVariabler)r,rr)rWrrrrrrs r[r.$FunctoolsPartialVariable.var_getattrs>DKK!> 6>99  6>))$))FC C : ?C}}?R?R?TU?Ttq%,,Q/2?TEU..uD D ) ),,T8 8 4 Vs#C/c B[R"URR5/URVs/sHoR5PM snQ70UR R 5VVs0sHup#X#R5_M snnD6$s snfs snnfrt)rrDrDrrrCr)rWrNrrs r[r+FunctoolsPartialVariable.as_python_constant,s  II ( ( * 26)) <)3$$&) < 6:]]5H5H5JK5JTQq&&((5JK  <K B 4Bc B[R"URR5/URVs/sHoR5PM snQ70UR R 5VVs0sHup!X!R5_M snnD6$s snfs snnf)zcSimilar to as_python_constant(), but add ID_MATCH guards to try to force things to become constants)rrDrDguard_as_python_constantrrCr)rWrrs r[ra1FunctoolsPartialVariable.guard_as_python_constant3s  II . . 0 48II >Iq((*I > <@==;N;N;PQ;P41q,,..;PQ  >Qr_)rrErDrCrr)rmrnrorpr4r\rrrrrrr.rrarqr\r]s@r[rArAs 6_ 64 6!  )G #G&G- G  G ) 14   55 5S 5   r^rAc^\rSrSrSSS1\R kr\\RS\ \ S\ 4\ R44Sj55r\S5rS\SS 4U4S jjr\S\4S j5rS rS rSSjrSSjrSrSrU=r$)PolyfilledFunctionVariablei<rr` traceable_fnrr.c0$rtra)rs r[_get_polyfill_handlers1PolyfilledFunctionVariable._get_polyfill_handlersDs  r^c^[UR[R55 U"XS9$r)r"rr!rrs r[r-PolyfilledFunctionVariable.create_with_sourceIs&f'' (C(CDE5((r^Nc D>[TU]"S0UD6 XlUR5R X5n[ U5(d SUSU35eSH,n[ X4S5nU(dM[ U5(deUn O [SUS35eX0lX`l g)NzPolyfill handler z is not callable for )__torch_dynamo_polyfill____python_implementation__z# does not have a traceable functionra) rr\rrgrvcallablerr=r`re)rWrrhandlercandidate_attr candidaterers r[r\#PolyfilledFunctionVariable.__init__Os "6"--/33B;  X$5gY>STVSW"XX  N >Iy ****(  #G9,OP & ,r^cUR$rt)rers r[ polyfill_fn&PolyfilledFunctionVariable.polyfill_fnfs   r^c0[URSS5$)N*__torch_dynamo_can_constant_fold_through__F)rr`rs r[can_constant_fold_through4PolyfilledFunctionVariable.can_constant_fold_throughjs OOI5  r^c"UR5$rtrPrs r[r'PolyfilledFunctionVariable.get_functionorRr^c rUR5(a[X#5(awUR"UVs/sHoDR5PM sn0UR 5VVs0sHupVXVR5_M snnD6n[ R "X5$UR[RLGa<[U5S:XGa,U(Gd$[US[R[R45(a[SUSR55(a[RR!UUR"R%S[&R([+SUSR55405[&R("USRVs/sH:n[U[R,5(a UR.O UR0PM< sn5S9$[ R "XR25nUR5XU5$s snfs snnfs snf)Nr0rc3# UH~n[U[R5=(a [UR[5=(d7 [U[R 5=(a UR 5[Lv M g7frt)rrr6rintSymNodeVariabler)rrVs r[r;PolyfilledFunctionVariable.call_function..sd'AAy99:Wz!''SV?WYq)";";<WTWAWY&sBBrc3@# UHoR5v M g7frt)as_proxy)ras r[rrs?A::<<s)sym_num)rxr(rrrr4rrsumrhrrrZ TupleVariablerrrr create_proxyrsym_sumrr6rrrer) rWrrrrVrrrtraceable_function_variables r[r(PolyfilledFunctionVariable.call_functionrs  ) ) + +0M 1 1 6:;d**,d;=C\\^L^TQq..00^L  #((4 4 GGx|| #D Q47Y%;%;Y=T=T$UVVa ,,33 &&#MM?a??A   "&a  "/A *!Y-G-GHHGG!"+"/  4 ('6&;&;B@Q@Q&R#*886JJO<L4sH)%H.-AH4cvUS:XaURXU5$[URUS5nUcSUSUR35e[U5(dSUSUR35e0nUR(a[ URU5US'[ U40UD6nURXU5$)N__call__zMember z not found in z is not callable in r)rrrr,rr#rd)rWrrrrmethodrpolyfilled_method_variables r[rn&PolyfilledFunctionVariable.call_methods : %%b7 7$-!JWTF. #JJ!6""QgdV3Gy$QQ" ;; *4;; =GH %?%R'%R")77&IIr^cUR$rtr rs r[r-PolyfilledFunctionVariable.as_python_constantr r^)rrer`rrrrrrrr4)rmrnrorpr4rZr[rcacherfrrrrrgrr=r\propertyrtrxrrrnrrqr\r]s@r[rdrd<s   ' ' N__tHS#X,>@R@R,R'S)) -2-D-.!R!! )2K #2K&2K- 2K  2KhJ& J - J  J&r^rdc\rSrSrSrSrg)TracebackVariableicgrtrars r[rTracebackVariable.call_functionssr^raNrmrnrorprrqrar^r[rrs2r^rc:^\rSrSrU4SjrSrSrSrSrU=r $)SysFunctionVariableic 2>[TU]"S0UD6 Xlgr`)rr\r)rWrrrs r[r\SysFunctionVariable.__init__s "6" r^cz[UR5(aKURSnURnSn[R"X5U[R"X5/nOA[ R "S5[ R "S5[ R "S5/n[ R"U5$)Nr)rh exn_vt_stackrr4rrr6r)rWrexnrTtbrs r[exc_infoSysFunctionVariable.exc_infos r  //"%C,,CB%%b.%%b-E**40**40**40E &&u--r^c>URU5RS$r&)rrrs r[ exceptionSysFunctionVariable.exceptions}}R &&q))r^cUR[RLaURU5$UR[RLdeURU5$rt)rrrrrs r[r!SysFunctionVariable.call_functionsF :: %==$ $zzS]]***~~b!!r^r) rmrnrorpr\rrrrqr\r]s@r[rrs.$*""r^r) create_tma_experimental_metadatacreate_tma_stable_metadataTMADescriptorMetadataTritonHOPifierc\rSrSrS\S\4SjrS\S\4Sjr S\S\4Sjr S\ \ RRRS 44S jrS rS rS rSrS\S\4SjrSSS\\SS4SjrS\4SjrSrg)DynamoTritonHOPifierirUrrc[U5ert)r )rWrUs r[raise_unsupported&DynamoTritonHOPifier.raise_unsupporteds #r^maybe_callablec.[U[[45$rt)rrr)rWrs r[ is_callable DynamoTritonHOPifier.is_callables 79MN  r^rcUR$rtr)rWrs r[ get_valueDynamoTritonHOPifier.get_values yyr^.cSSKJn [X5(aUR5$[ SS[ U53S/[ RQS9 g)Nr0)BaseListVariablez/unsupported grid type for triton hop check_gridz grid type = z;`torch.compile` only supports list-like grid for check_gridr)listsrrrrrfrr')rWgridrs r[ check_gridDynamoTritonHOPifier.check_gridsK+ d - -==? " I&tDzl3Y&22  r^cUR5VVs0sH%upE[RRU5U_M' nnnUR X2/05nU$s snnfrt)rrr6rr)rWrmetarrrs r[ call_gridDynamoTritonHOPifier.call_gridsSDHJJLQLDA **11!4a7LQ!!"fb1 Rs,AcXSSKJn URXA5nURXBU5nU$)Nr0r)rrrr) rWuser_fnrrrrrwrapped_user_functionrs r[call_user_defined_fn)DynamoTritonHOPifier.call_user_defined_fn s-. 1 8 8 E&44RvF r^clSSKJn U"U[URU55R U5nU$)Nr0)VariableBuilder)rrr# kernel_source_wrap)rWuser_objrrrrwrapped_user_objs r[wrap_user_defined_obj*DynamoTritonHOPifier.wrap_user_defined_objs7,*  811dV= %/  r^crURU5nUVs/sHo3R"5PM nnU$s snfrt)unpack_var_sequencera)rWconfigsrrs r[maybe_unpack_configs)DynamoTritonHOPifier.maybe_unpack_configss<--b1DKK72247KLs4rcnUR5(dURS5 UR5$)Nz`@triton.heuristics must return constant values because configs can only contain constant values.)is_python_constantrra)rWrs r[maybe_unpack_heuristic_result2DynamoTritonHOPifier.maybe_unpack_heuristic_result$s3((**  " "r ..00r^rTritonKernelVariablercURc[U5S:waURS5 [U5"URUR USUR S9$)Nr0z7Triton kernels should be called with only a single gridr)kernel kernel_idxrr)rrhrrfrrr)rWrrs r[ call_getitem!DynamoTritonHOPifier.call_getitem.sZ == $D Q  " "I H~??**a"//   r^c `SSKJn SSKJn 0n[ UR 55HHnX8n [ U [[45(dM$U R5Xx'U R5X8'MJ UR5VV s0sH%up[RRU5U _M' n nn SSKJn Jn UR5VV s0sH'up[ X5(dMXR#5_M) n nn U R5VV s0sHup[ X5(aMX_M nnn UR%5Hbn U R'5n [ U [R([R*45(aMDUR-S[/U 5S35 Md U R1U 5nU"U[25nUR4R7SU S UR8UUUUR;5S .5 [R"S5$s sn nfs sn nfs sn nf) Nr0r5)r[r)kernel_side_tabletriton_kernel_wrapper_mutationz.Unexpected argument type for a Triton kernel: rrra)rconstant_args_idxrtma_descriptor_metadatar)rr6dictsr[rrr!TMADescriptorExperimentalVariableTMADescriptorStableVariable to_metadata get_tensorrrr*torch._higher_order_ops.triton_kernel_wraprrrr realizerTrrrepradd_constant_argsrfrrrr)rWrgridscombined_args_rawrr6r[rrr combined_argsrrr>non_constant_argsrrs r[call_HOPDynamoTritonHOPifier.call_HOP@s .,:<',,./A!$A57RS./]]_'*'(||~!$ 0*//1 1  & & - -a 0! 31   *//1 1!. &A##% %1  &++- -a2 AD-  #))+A Aa)":":IURSS5Ul[TU] "S0UD6 [R XX#5 g)Nrra)r~rrr\ dynamo_triton_hopifier_singleton init_variable)rWrrrrrs r[r\TritonKernelVariable.__init__s6#ZZ> "6"(66tZVr^c.[RXX15$rt)rcall_triton_kernelrs r[r"TritonKernelVariable.call_functions 0BB   r^c>US:Xa[RX5$US:Xa[RXXA5$[TU]XX45$)N __getitem__run)rrcall_runrrnrqs r[rn TritonKernelVariable.call_methodsL = 3@@L L U]3<? ? r^)rrYrr)rmrnrorprrr~r\rrnrrrqr\r]s@r[rrs   W  # & -     ;& ; - ;  ;ssr^rcR^\rSrSrSU4SjjrSrSSjrSrSrU=r $) ric >[U[R5(de[TU]"S0UD6 XlX lX0lX@lgr`) rrDataPtrVariablerr\data_ptrdims block_dims element_size)rWr r r rrrs r[r\*TMADescriptorExperimentalVariable.__init__sC(I$=$=>>>> "6"  $(r^c[URVs/sHoR5PM snURVs/sHoR5PM snURR55$s snfs snfrt)rr rr r)rWdims r[r-TMADescriptorExperimentalVariable.to_metadatas[/'+yy 1y\\^y 1'+ 7\\^ 7    & & (  1 7s A6A; c^^TRUU4Sj5 TRRT5 /TRQTRQTR PnTR U5 TR[U5S-S5 g)NcV>TRSS[TR5S35$)Nz$triton.tools.experimental_descriptorcreate_d_tma_descriptor)rrhr r;sr[r<?TMADescriptorExperimentalVariable.reconstruct..s)G,,6#dii.))9:r^r0F) r@r rr r rrLrrh)rWrrs`` r[r-TMADescriptorExperimentalVariable.reconstructsp  !!'*@@T__@d.?.?@c$i!mU3r^c.URR$rt)r  from_tensorrs r[r,TMADescriptorExperimentalVariable.get_tensors}}(((r^)r r r r)r zvariables.DataPtrVariabler list[ConstantVariable]r rrr6r rmrnrorpr\rrrrqr\r]s@r[rrsB )- )' )- ) ) )  4))r^rcN^\rSrSrSU4SjjrSrSSjrS SjrSrU=r $) ric >[U[R5(de[TU]"S0UD6 XlX lgr`)rrrTrr\r block_shape)rWrr rrs r[r\$TMADescriptorStableVariable.__init__s9 &)":":;;;; "6" &r^cH[URR55$rt)rr rrs r[r'TMADescriptorStableVariable.to_metadatas!)    % % '  r^c^TRU4Sj5 TRS5 URRT5 T"UR5 TR S5 g)Nc(>TRSS5$)Nztriton.tools.tensor_descriptorTensorDescriptorrrsr[r<9TMADescriptorStableVariable.reconstruct..sG,,0"r^rr)r@ load_methodrrr rnrBs `r[r'TMADescriptorStableVariable.reconstructsT  M* (  !Ar^cUR$rt)rrs r[r&TMADescriptorStableVariable.get_tensors {{r^)r r)rvariables.TensorVariabler zvariables.ListVariabler)rrr,rr]s@r[rrs. '* '. ' r^rcN^\rSrSrS\SS4U4SjjrSSjrSrU=r$) 'CreateTMADescriptorExperimentalVariableirankrrNc B>US;de[TU]"S0UD6 Xlg)N)r0rra)rr\r/)rWr/rrs r[r\0CreateTMADescriptorExperimentalVariable.__init__ s& v~~ "6" r^c$SU;aUSOUSn[U[R5(d[SURS35eURS:Xa@[ U5[ U5-S:XdeSU;aUSOUS/nSU;aUSOUS /nO][ U5[ U5-S :XdeS U;aUS OUSS U;aUS OUS /nS U;aUS OUSSU;aUSOUS/nSU;aUSOUSn[ UUUUS9$)Nptrrz8Please ensure there were no graph breaks between create_z3d_tma_descriptor and the upstream .data_ptr() call.r0r?r block_dimrdim1dim0 block_dim1r block_dim0rr)r r r r)rrr r r/rhr)rWrrrr3r r rs r[r5CreateTMADescriptorExperimentalVariable.call_function sd %fUmDG#y8899))%$$  99>t9s6{*a/ //!&&u d1gD(3f'<{#$q'Jt9s6{*a/ //"(F"2vQ"(F"2vQD )5(>|$DG(4(>|$DGJ2@61Ivn-tTVx 0!%   r^)r/r) rmrnrorpr~r\rrqr\r]s@r[r.r.sJ  ( #( &( - (  ( ( r^r.c.\rSrSrSSjrSrg)!CreateTMADescriptorStableVariablei4 cVSU;aUSOUSnSU;aUSOUSn[UUS9$)Nrrr r0)rr )r)rWrrrrr s r[r/CreateTMADescriptorStableVariable.call_function5 sF &.%7!T!W/</Ff]+DQRG *#  r^raNrrrar^r[r<r<4 s-  #  &  -    r^r<rtr)rrrrrrrrrcollections.abcrrtypingrrrr r typing_extensionsr unittest.mockr weakrefr rtorch._dynamo.excrrrrrrbytecode_transformationrrrrrrrrrrrrrr guardsr!r"rr#r$r%r&rEr'r(r)r*r+r,r-r.r/baser1r2r3r4rr6#torch.distributed.fsdp._fully_shardr7ModuleNotFoundErrortorch._dynamo.codegenr8rr:rr;r<r=rSrUrurBrxrr|rrfrrrrrrrr_rtrrrr r,rIrBrrrrrrrr rr1r9rArdrrrrrrrrrrrr.r<rar^r[rKs.  $BB#% 4>>VV   1NN    'E /D  T"   !   >L\2j A. $sO';"< "(-"DW73W7t:4:<}4?}4@   4 %=4 n" 2>2>"6>0  p)!9p)f%>(B%>PWA?WAt>"6>2> /> B  ; /QD(<QDh7174 $8 :N N b~~B33 "/"BX >X v$8#9 +?+\$)$)N/B2 o2 j    EGsJJJ