7hS>lSrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK J r SSKJrJrJr SSKrSSKrSSKJrJr SSKJr SSKJr \R6"\5r\R<"S S 9"S S 55r\R<"S S55r \"S\!5r"\"S\!5r#\R<"SS55r$\R<"SS55r%\RL"SS\\%55r'"SS5r(\RL"SS\\55r)"SS5r*g)a This module provides the infrastructure for creating and managing compile package for torch.compile. We mainly have two abstractions here: - CompilePackage: Overarching data structure for store and lookup a list of compiled codes. - CodeCacheEntry: Data structure for a single code being compiled by torch.compile. The caching behavior is always under user control explicitly so that a stronger guarantee can be provided about cache hit for a specific compiled model. Users can load the compile package from a different process or host. N) Generator)AnyNewTypeOptional)PrecompileCacheArtifactPrecompileContext)CacheArtifactFactory) get_code_keysT)frozenc\rSrSr%\\S'\\S'\\S'\\S'\\S'\\S'\\S'\\S 4\S '\\ S 4\S '\\ S 4\S '\ \S '\ \S'\\S'\\ S 4\S'\\ S 4\S'Sr \ \\S'Sr \ \ \S'Sr \ \\S'Sr\ \ \S'\\R"S\R&SS4Sj55r\\R"SSS\R&4Sj55rSrg)SerializedCode$ co_argcountco_posonlyargcountco_kwonlyargcount co_nlocals co_stacksizeco_flagsco_code. co_constsco_names co_varnames co_filenameco_nameco_firstlineno co_cellvars co_freevarsN co_linetable co_qualnameco_exceptiontable co_lnotabcodereturnc^[5Vs0sHo"[X5_M nn[U4SjUS55US'T"S0UD6$s snf)Nc3># UH7n[U[R5(aTRU5OUv M9 g7fN) isinstancetypesCodeTypefrom_code_object.0cclss O/var/www/fran/franai/venv/lib/python3.13/site-packages/torch/_dynamo/package.py 2SerializedCode.from_code_object..>s8$ ((2!U^^'D'DC  #! K(s?Ar)r getattrtuple)r/r#keykwargss` r0r+SerializedCode.from_code_object:sY6C_E_cwt))_E#$ K($  {}V} FsAserialized_codec^[5Vs0sHo"[X5_M nn[U4SjUS55US'[R"UR 56$s snf)Nc3t># UH-n[U[5(aTRU5OUv M/ g7fr')r(rto_code_objectr,s r0r10SerializedCode.to_code_object..Hs4$ (&0>%B%BC  q ! I(s58r)r r4r5r)r*values)r/r9r6r7s` r0r<SerializedCode.to_code_objectDshANPw44P#$ K($  {~~ ]]_  QsA!r3)__name__ __module__ __qualname____firstlineno__int__annotations__bytesr5rstrrrr r!r" classmethod functoolscacher)r*r+r<__static_attributes__r3r0rr$sOM NS#XCHosCx  LsCx sCx $(L(5/(!%K#%)-x-#Ix}#__ENN7G__ -= %..  rLrc.\rSrSr%Sr\\S'\\S'Srg)_GuardedCodeCacheEntryQz Contains the serializable information associated with a single compilation in dynamo. To restore an execution of compiled code, we will need to serialize the following data: - Dynamo bytecode for mapping Python inputs/outputs. - Dynamo guards. guards_state dynamo_coder3N) r@rArBrC__doc__rFrErrKr3rLr0rNrNQsrLrN _BackendId _FunctionIdcr\rSrSr%Sr\\S'\\S'\\ \S'\\ \S'\ \\4\S'\\ \S'S r g ) _DynamoCodeCacheEntrybaQ Contains the serializable information associated with a single code object in dynamo. To restore an execution of compiled code, we will need the following ingredients: 1. The "original" code object, which serves as the entry point for eager execution, i.e. the code only executed when there's no cache entry hit. 2. The python module name this code object belongs to, for identifying the enclosing global scope to inject compiled and resume functions. 3. A list of function names that pointing to this code object. There could be multiple function objects pointing to the same code such as recursive functions. 4. A list of guarded code that eval frame dispatches to. 5. A list of imported module objects unioned from all compiled branches. 6. A list of "backends" (compiled fx graph) unioned from all compield branches. python_code python_modulefunction_names guarded_codesimport_sources backend_idsr3N)r@rArBrCrRrrErGlistrTrNdictrSrKr3rLr0rVrVbsE  %%.//cN"j!!rLrVc\rSrSr%\\\S'\R"5r\ \S'\ Rr \ \S'\ S\\4Sj5rSrg) _DynamoCacheEntry{codespython_version torch_versionr$cpURVVs1sHoRHo"iM M snn$s snnfr')rcr])selfr# backend_ids r0r]_DynamoCacheEntry.backend_idss+'+zzUztDTDTj DT zUUUs2r3N)r@rArBrCr^rVrEplatformrdrGtorch __version__repropertysetrSr]rKr3rLr0rara{sQ % &&"113NC3**M3* VS_VVrLrac:\rSrSr\S\4Sj5rS\4SjrSr g)_DynamoCacheArtifactr$cg)Nprecompile_dynamor3r3rLr0type_DynamoCacheArtifact.types"rLcB[R"UR5$r'pickleloadscontentrgs r0after_deserialization*_DynamoCacheArtifact.after_deserialization||DLL))rLr3N) r@rArBrC staticmethodrGrtrar|rKr3rLr0rprps(####*'8*rLrpc *\rSrSrSrS%S\S\\SS4SjjrS%S\S\\SS4Sjjr S%S \ RS \ S \\ SS4S jjr\S\\\44S j5r\R(S\ 4Sj5r\R.S\ RS\S4Sj5rS\S\ RSS4SjrS \ RS \ S \\ SS4SjrS\ S\ SS4SjrS%S\ S\\SS4SjjrS&SjrS\ R@S \ S\SS4Sjr!S&S jr"S!\\\4SS4S"jr#S\4S#jr$S$r%g)'CompilePackagea| CompilePackage is considered a low level component and should not be directly exposed to end users. It has the following interface: 1. `CompilePackage.__init__()` which optionally takes previously serialized dynamo states. a. when `dynamo` argument is None, it will construct a brand new CompilePackage object. b. when `dynamo` argument is not None, it will load a pre-compiled dynamo state. 2. `package.save()` which dumps the dynamo and backend states to a DynamoCacheEntry object. 3. `package.install(backends) which will handle all the side-effectful global scope updates with compiled functions and resume functions. Nfndynamor$cSUl0UlSUl0Ul0UlUR X5 UR 5 UR5 gr') _innermost_fn_codes_current_entry_installed_globals_cached_backends _initialize uninstallvalidate)rgrrs r0__init__CompilePackage.__init__sL!CE ?CEG8: $  rLcSSKJn U"U5UlURceUb[U[5(deUR [ R "5:wa[SUR 35eUR[R:wa[SUR35eURtpEURRU0Ul UH.nX`R[RUR 5'M0 gUR#URRURR$5 g)Nr ) innermost_fnz=Compile package was created with a different Python version: z>Compile package was created with a different PyTorch version: ) eval_framerrr(rardrj RuntimeErrorrerkrlrc__code__rrr<rX _add_functionrA)rgrrrmainrcr#s r0rCompilePackage._initializes",)"-!!---  f&788 88$$(?(?(AA"STZTiTiSjk##u'8'88"TU[UiUiTjk"<rLbackendsc |SSKJn UR5 URR 5GH up4[ R URnURR 5H+upgURXV[R"U55 M- URH6n[R"X5RU5n URXXU 5 M8 UR HKn X;a[#SU S35eXn URUU [$R&R)U 55 MM GM URR 5Hup4UR*Hn [,R."U R05n [3U [$R&R4R65(de[$R&R4R9UU R:SU R<S9nU"UUR>[@RCU RD55 M M g)a  Sync the package states to the compiled function. This includes the following actions: 1. Clean up the previously installed states. 2. Install the compiled functions to global scopes. 3. Install the precompiled cache entries to ExtraStates on the code object. r)_load_precompile_entryBackend # is not found in the given backendsload)guards_serialization_modeshape_code_partsN)#rrrrrsysmodulesrYr\r importlib import_modulerZr) FunctionTyperr]rrk_dynamodisabler[rxryrPr(guards GuardsStateCheckFunctionManager output_graphr guard_managerrr<rQ)rgrrr#rrrr function_namerrhr guarded_coderPcheck_fn_managers r0installCompilePackage.install)s G ;;,,.KD[[!4!45F&+&:&:&@&@&B"$$9#:#:;#G'C"'!5!5 ''oo}M$$VB?"6$// -&":,.QR#.$$MM))'2 0/* ;;,,.KD % 3 3 %||L,E,EF !, 0D0D0P0PQQQQ#(==#7#7#L#L --.4%1%B%B $M$ '$22"11,2J2JK!4/rLcvUR5 [[URR 55S9$)N)rc)rrar^rr>r{s r0 cache_entryCompilePackage.cache_entryYs(  tDKK,>,>,@'ABBrL)rrrrrr')r$N)&r@rArBrCrRrrrarrr)r*rGrTrrmr_rSrrIcached_propertyr contextlibcontextmanagerrrrFrrrrr ModuleTyperrrrrKr3rLr0rrs  3 1B(C t c84E+FRV:'+ -^^--{# -  -.%j#o!6%%'3''''I>N4O'' E E^^ E  E ^^  sm    @s@@@88x}8PT8F De&6&6DcD#DRVD ?.Z_ 5.$.`C.CrLrc:\rSrSr\S\4Sj5rS\4SjrSr g)EagerCacheArtifacti^r$cg)Nprecompile_eagerr3r3rLr0rtEagerCacheArtifact.type`s!rLcB[R"UR5$r'rwr{s r0r|(EagerCacheArtifact.after_deserializationdr~rLr3N) r@rArBrCrrGrtrr|rKr3rLr0rr^s'"#""*s*rLrc \rSrSrSrS\SS4SjrS\S\SS4S jr S\S \ SS4S jr S \S \ S\ \\ \\444S jrSrg) DynamoStoreihz_ A DynamoStore tracks active CompilePackages, and provides methods to store and retrieve them. packager$NcUR5n[R"U5n[R"[ R 5URUS9 g)zKRecords a package to PrecompileContext, so that it can be serialized later.r6rzN)rrxdumpsrrecord_artifactrprtr)rgrrpickled_results r0record_packageDynamoStore.record_packagemsB))+ k2)) % % 'W->-> rLrhrc~[R"U5n[R"[R 5XS9 g)zBRecords eager fx graphs to PrecompileContext for testing purposes.rN)rxrrrrrt)rgrhrrs r0record_eager_backend DynamoStore.record_eager_backendus,g.))  # # %: rLpathcX0nUR5nURH/n[R"U5nUc[ SUS35eXcU'M1 [ [ RRUS5S5n[R"XG5 SSS5 [ [ RRUS5S5n[R"X85 SSS5 g!,(df  NX=f!,(df  g=f![an [ SUSU 35U eSn A ff=f) zGSaves a package to a given path. Grabs backends from PrecompileContext.NrrrwbrzFailed to save package to : ) rr]rserialize_artifact_by_keyropenosrjoinrxdump Exception) rgrrbackend_contentrrhserialized_backend dynamo_path backend_pathes r0 save_packageDynamoStore.save_package|s))+ %11J!2!L!LZ!X !)"zl*MN+=J ' 2 Pbggll42D9[ K5:bggll44d;| O:<;:9;; P!;D6A3GHa O PsN*D=C&2DC7D& C40D7 DDD D)D$$D)rc([[RRUS5S5n[R "U5nSSS5 [[RRUS5S5n[R "U5nSSS5 WR5HupU R5Xh'M [UW5n X4$!,(df  N=f!,(df  NY=f![ an[SUSU35UeSnAff=f)zULoads a package from a given path and returns it plus a list of deserialized backendsrrbNrz!Failed to load package from path r) r r rr rxrr rrr|r) rgrrrrrrrrhrrs r0 load_packageDynamoStore.load_packages Wbggll42D9[$kk+6 :bggll44d;|"(++l";<$3#8#8#: J*1*G*G*IO '$; [1'':9;; W!B4&1#NOUV V WsL*C0C2C05C C0 CC0 C-)C0-C00 D:D  Dr3)r@rArBrCrRrrrSrrrGrr5r_rrKr3rLr0rrhs n   z C D PNP#P$P&(( ( ~tJO44 5(rLr)+rRr dataclassesrIrrloggingr rxrjrr)collections.abcrtypingrrrrktorch._inductor.package torch._dynamo.precompile_contextrrtorch.compiler._cacher bytecode_transformationr getLoggerr@logger dataclassrrNrGrSrTrVraregisterrprrrr3rLr0r%s^  %)) W62   8 $ d#) ) $) X      \3 ' mS)  """0 VVV*23DE**KCKC\*05**5(5(rL