h&1SrSSKrSSKr\"S5rS SjrSrSSjrSSjrSr S r \ S :XaO\"5r \ "S \ 5 SS KJr \"\ R 5 \ R"r\ "\\ 5r\H r\ "\5 M gg)zThis profiler result processor print out the kernel time spent on each Node of the model. Example of importing profile result file from onnxruntime_perf_test: python profile_result_processor.py --input profile_2021-10-25_12-02-41.json N)ScanLoopIfc\[R"5nURSSS[SS9 URSS[SSS 9 URS S[S S S 9 URS SSSS9 UR SS9 URSSSSS9 UR SS9 UR U5$)Nz-iz--inputFz2Set the input file for reading the profile results)requiredtypehelpz --thresholdg{Gz?zfThreshold of run time ratio among all nodes. Nodes with larger ratio will show in top expensive nodes.)rrdefaultr z --providercudazExecution provider to usez--kernel_time_only store_truez.Only include the kernel time and no fence time)ractionr )kernel_time_onlyz-vz --verbose)rr )verbose)argparseArgumentParser add_argumentstrfloat set_defaults parse_args)argvparsers k/var/www/fran/franai/venv/lib/python3.13/site-packages/onnxruntime/transformers/profile_result_processor.pyparse_argumentsrs  $ $ &F    A    u    (   =  / kE,O &   T ""c[SUS35 [U5n[R"U5nSSS5 [ W[ 5(deU$!,(df  N'=f)Nzloading profile output z ...)printopenjsonload isinstancelist) profile_file opened_file sess_times rload_profile_jsonr&;sU #L> 67 l {IIk*   i & && &   s A A!c "0n0n0nSnSnUHnUSS:Xa USS:XaSnU(dM USS:XdM+S U;dM3S U;dM;S US ;dMFUSnUS S n U [;aM_U (dS US 3n X;aX8==US - ss'XH==S- ss'OUS X8'SXH'XU'XWS - nM U(dS/$/n U RSUS-SS35 U RS5 U RS5 [UR5SSS9HHupX- n X:aMXHn U [ U 5- nU RU SSU S-SSU SSUSSU3 5 MJ 0nUR5H upX8n X;aX==U - ss'MXU 'M" U RS5 U RS5 U RS5 [UR5S SS9H'upX- n U RU SSU S-SSU 35 M) U $)!a$Parse profile data and output nodes in two sections - nodes in the original order, and top expensive nodes. Args: sess_time (List[Dict]): profile data threshold (int, optional): Minimum ratio of duration among all. Defaults to 0. Returns: List[str]: lines of string for output. rFcatSessionnamesession_initializationTKerneldurargsop_name()zNo kernel record found!z% Top expensive kernels with Time% >= d.2f:@----------------------------------------------------------------u&Total(μs) Time% Calls Avg(μs) Kernelc US$Nr2xs r&parse_kernel_results..xs1Q4rkeyreverse10d Y@5.2f5d8.1fz Group kernel time by operator:uTotal(μs) Time% Operatorc US$r8r9r:s rr<r=s1Q4r)_NODES_TYPE_CONTAINING_SUBGRAPHappendsorteditemsr)r% thresholdkernel_name_to_op_name kernel_time kernel_freqtotal session_inititem kernel_namer/linesdurationratiocallsavg_timeop_times rparse_kernel_resultsrZEs~ KK EL ;) #V 8P(PL  ;( "u}4IY]^dYeLev,K6l9-G99k]!,)(DK7((A-(+/; (+, (6={3 %[ E58 )** E LL9)c/#9NaPQ LL LL=>!' (9(9(;Y]!^     (eEl* ~R d';2eBZr(SWXZ[fZghi"_G 6 < < > +     ( 'G  !? LL34 LL LL./#GMMOQUV  ~R d';2gYGHW Lrc/n0n0n0nSnUGH nUSS:XdMSU;dMSU;dMSUS;dM*USRSS 5RS S 5RS S 5n S US;aAUSS S :XaSn OUSS S:XaSn OUSS S:XaSn X;aW Xi'OXiW :XdeO U(aMUSSn U [;aMX;aXI==US- ss'XY==S- ss'OUSXI'SXY'URU 5 XxS- nGM /SQn Sn UHbn XInXYnU[U5- nX- S-nUR U S 5nU U- n U RUSSUSSU SSUSSUSSUSSU 3 5 Md U RSUS-SS 35 U RS!5 U RS"5 [ UR 5S#S$S%9HcupX- nUU:aMXYnU[U5- nX- S-nUR U S 5nU RUSSUSSUSSUSSUSSU 3 5 Me U $)&aParse profile data and output nodes in two sections - nodes in the original order, and top expensive nodes. Args: sess_time (List[Dict]): profile data kernel_time_only (bool, optional): Only include items for kernel time. Defaults to False. threshold (int, optional): Minimum ratio of duration among all. Defaults to 0. Returns: List[str]: lines of string for output. rr(Noder-r.r/r* _kernel_time _fence_before _fence_afterproviderCPUExecutionProviderCPUCUDAExecutionProviderCUDADmlExecutionProviderDMLr2)z Nodes in the original order:r6u3Total(μs) Time% Acc % Avg(μs) Calls Provider NodegrCrArBrDrFrE8sz# Top expensive nodes with Time% >= r3r4r5r6u-Total(μs) Time% Avg(μs) Calls Provider Nodec US$r8r9r:s rr<$parse_node_results..sqtrTr>)replacerHrIrgetrJrK)r%rrLnode_name_list node_time node_freq node_providerrPrR node_namedevicer/rTbefore_percentagerUrWrX percentagerarVs rparse_node_resultsrusNIIM E ;& Ud]v~)W[\bWcJcV $$^R8@@RTU]]^lnpq T&\)< +/EE"F&\*-1HH#F&\*-1GG"F1/5M,(3v===!6l9-G99%$U 3$$)$'+E{ $'( $%%i0 %[ ECH E # '$eEl*&%/  $$Y3Z' nBz$/r2CD1IHUY?Z\]bce\ffhiqrthuuwyBxC D $ LL7 C7LANO LL LLEF%ioo&7^UYZ   9  $eEl*&%/  $$Y3 ~R 4'88D/ERT:UWX`acWddfgpfqrs [ Lrc40n0nSn0n0n0n0nSn0n UGH"n U SS:XdMSU ;dMSU ;dMSU S;dM*U SSn U [;aM>SU S;a.SU S ;a#X;aX{==U S- ss'OU SX{'XS- nMuU SRSS 5n X;a X==S - ss'OS X'U S U 3n X;aXM==U S- ss'X]==S - ss'O U SXM'S X]'X;aXl==U S- ss'OU SXl'X;aX==U S- ss'X+==S - ss'O U SX'S X+'X:S- nGM% S S /nURS5 URS5 [UR 5SSS9HeupURU S5nX- nUU-nUX8-- nX+nUU- nURUSSUS-SSUSSUS-SSUSSUSSUSSU 35 Mg US S/- nURS5 URS5 [UR 5SSS9HlupU R S 5nUSn US n U R SS 5nX]nUU- nXU - nURUSSUS-SSUSSUSSUSSU 3 5 Mn U$) zGroup results by operator name. Args: sess_time (List[Dict]): profile data Returns: List[str]: lines of string for output. rr(r\r-r.r/rafencer*r^r2r5zGrouped by operatorr6uMTotal(μs) Time% Kernel(μs) Kernel% Calls AvgKernel(μs) Fence(μs) Operatorc US$r8r9r:s rr<$group_node_results..0sQqTrTr>rArBrCrD11drEz14.1fzGrouped by provider + operatoru<Kernel(μs) Provider% Calls AvgKernel(μs) Provider Operatorc US$r8r9r:s rr<ry>s RSTURVrExecutionProviderz9.2frh)rHrlrIrJrKsplitrk)r%op_kernel_timeop_kernel_recordstotal_kernel_timeprovider_op_kernel_timeprovider_op_kernel_recordsprovider_kernel_time op_fence_timetotal_fence_timeprovider_counterrRr/rar?rTrN fence_timekernel_time_ratio total_time time_ratio kernel_callsavg_kernel_timepartsshort_eprWprovider_time_ratios rgroup_node_resultsrsN !#M ;& Ud]v~)W[\bWcJc6l9-G99f-d6l*/%.$u+=.15e .$U 3$F|'' B7H+ *a/*-. *Jay)C-',U ;,*/14//3E{',23*//$.$u+=.15e$.('4;6'!*a/**.u+'-.!* e , WZ& 'E LL LLgh &~';';'=>[_ `"&&w2 '; :- #4#GH (1 % 4 #be!3D 9K;LBO`chOhimNnnpq}AqBBDETUZD[[]^hil]mmopwox y !a b2 33E LL LLTU"#:#@#@#B`de #8(##$7<*/%-),JJ 3r"5"=d!C2eBZrRabgQhhjkstvjwwy{BzC D f Lrc[U5n[X!R5nU[X!RUR5- nU[ U5- nU$N)r&rZrLrurr)r#r.profile_recordsrTs rprocess_resultsrMsK' 5O .. AE 1F1F WWE  00E Lr__main__ Arguments) setup_loggerr)r)Fr)__doc__rr frozensetrHrr&rZrurr__name__ argumentsrbenchmark_helperrrinputr#resultsliner9rrrs   "+,B"C'#TL^Tn_D  z!I +y!-""#??LlI6G d r