U qhng@sddlmZddlmZddlmZmZmZmZm Z m Z m Z d,dddddd d Z d-ddd d d d d d d dd ddZ d.ddd d d d d d d d d d dddddZd/dddddddddddd d d!Zd0dddddddddddd" d#d$Zd1dd%ddd&d'd(Zd2dd%ddd)d*d+ZdS)3) annotations)MutableMapping)AttributeProto GraphProto ModelProto TensorProtocheckerhelperutilsNrzlist[tuple[str, str]] | Nonezlist[tuple[str, list[str]]])g1g2io_mapreturncCsTt|tk rtdt|tk r(tddddddd}ddd dd d d }g}|sZg}d d|D}||||||d}|r|d|f|dd|jDdd|jD}|r|d|f|dd|jDdd|jD}|r|d|f|dd|jDdd|jD|dd|jDdd|jD}|rP|d|f|S)aChecks whether there are name collisions between two graphs Returns a list of tuples where the first element represents the member containing overlapping names (One of: "node", "edge", "value_info", "initializer", "sparse_initializer"), and the second element contains a list of names that appear in both graphs on that category. Optionally, it takes an io_map, representing the output/inputs to be connected. It provided, overlapping present in the io_map argument will be ignored. g1 argument is not an ONNX graph g2 argument is not an ONNX graphz list[str])c1c2rcSstt|t|@S)N)listset)rrr0/tmp/pip-unpacked-wheel-xnis5xre/onnx/compose.py _overlapping$sz-check_overlapping_names.._overlappingNrzset[str] | None)graphexcludercSsn|dkrt}g}|jD]P}|jD]}|dkr"||kr"||q"|jD]}|dkrH||krH||qHq|S)N)rnodeinputappendoutput)rredgesniorrr _edge_names's    z,check_overlapping_names.._edge_namescSsh|] }|dqSr).0elemrrr 8sz*check_overlapping_names..)rZedgecSsg|] }|jqSrnamer&errr @sz+check_overlapping_names.. value_infocSsg|] }|jqSrr)r+rrrr-Fs initializercSsg|] }|jjqSrvaluesr*r+rrrr-LscSsg|] }|jjqSrr0r+rrrr-MscSsg|] }|jjqSrindicesr*r+rrrr-OscSsg|] }|jjqSrr2r+rrrr-Pssparse_initializer)N)typer ValueErrorrr.r/r4)r r r rr#resultZ io_map_inputsoverlaprrrcheck_overlapping_namessJ   r9zlist[tuple[str, str]]zlist[str] | Nonez str | None) r r r inputsoutputsprefix1prefix2r* doc_stringrc st|tk rtdt|tk r(tds0rrTt} | || }t|d}rxt} | || }t|d}fdd|D}dd|Ddd|Dd d |Dd d|jD} d d|jD} |s|r |sd d|jD} dd|jD}n2t|fdd|jD} fdd|jD}|sbdd|jD}dd|jD}n2t|fdd|jD}fdd|jD}t| t|jkst|t|jkrt t |}| | |j}t|t|jkst|t|jkr t t |}| ||j}|D]>\}}|| krFtd|d|| kr$td|dq$t|||}t|dkr|d\}}td|dd|ddt}|j|jt|j}|j|jt|j}dd d d!d"fd#d$ ||||rPt||jfd%d|jD|jfd&d|jDn*|j|j|jfd'd|jD|rt||jfd(d|jD|jfd)d|jDn*|jfd*d|jD|j|j|j|j|jfd+d|jD|j|j|jfd,d|jD|j|j|jfd-d|jD|d.k rx|nd/|j|jg|_|d.krd0|jd1|jd|jd2|jd2|jd2|j}||_|S)3aCombines two ONNX graphs into a single one. The combined graph is defined by connecting the specified set of outputs/inputs. Those inputs/outputs not specified in the io_map argument will remain as inputs/outputs of the combined graph. Arguments: g1 (GraphProto): First graph g2 (GraphProto): Second graph io_map (list of pairs of string): The pairs of names [(out0, in0), (out1, in1), ...] representing outputs of the first graph and inputs of the second to be connected inputs (list of string): Optional list of inputs to be included in the combined graph By default, all inputs not present in the ``io_map`` argument will be included in the combined model outputs (list of string): Optional list of outputs to be included in the combined graph By default, all outputs not present in the ``io_map`` argument will be included in the combined model prefix1 (string): Optional prefix to be added to all names in g1 prefix2 (string): Optional prefix to be added to all names in g2 name (string): Optional name for the combined graph By default, the name is g1.name and g2.name concatenated with an undescore delimiter doc_string (string): Optional docstring for the combined graph If not provided, a default docstring with the concatenation of g1 and g2 docstrings is used Returns: GraphProto rrprefixcs<g|]4}r|dn|dr.|dn|dfqSrr%rr&ior<r=rrr-sz merge_graphs..cSsh|] }|dqS)rrrBrrrr(szmerge_graphs..cSsh|] }|dqSr$rrBrrrr(scSsi|]\}}||qSrr)r&Zout_nameZin_namerrr sz merge_graphs..cSsh|] }|jqSrr)r&r"rrrr(scSsh|] }|jqSrr)r&r!rrrr(scSsg|] }|jqSrr)rGrrrr-scSsg|] }|jqSrr)rGrrrr-scsg|]}|jkr|jqSrr)rG input_setrrr-s cs&g|]}|jks|jkr|jqSrr)rG)rI io_map_g2_insrrr-s cSsg|] }|jqSrr)rFrrrr-scSsg|] }|jqSrr)rFrrrr-scs&g|]}|jks|jkr|jqSrr)rF)io_map_g1_outs output_setrrr-s csg|]}|jkr|jqSrr)rFrLrrr-s zOutput z is not present in g1zInput z is not present in g2rz=Cant merge two graphs with overlapping names. Found repeated z names: ,  zYConsider using ``onnx.compose.add_prefix`` to add a prefix to names in one of the graphs.rintNone) sub_graphstartendrcsvt||D]f}|j|}|jD]&}|jtjkr|jdt|jjqt|j D]\}}|krP||j |<qPq dSNr) ranger attributer5rZGRAPHglen enumerater)rRrSrTZnode_idxrattrindexZname_) connect_ioreversed_io_maprrr]s   z merge_graphs..connect_iocsg|]}|jkr|qSrr)rGrHrrr-s csg|]}|jkr|qSrr)rGrHrrr-s csg|]}|jkr|qSrr)rGrJrrr-s csg|]}|jkr|qSrr)rFrMrrr-s csg|]}|jkr|qSrr)rFrMrrr-s csg|]}|jkr|qSrr)rF)rKrrr-s csg|]}|jkr|qSrr)r&initr_rrr-s csg|]}|jjkr|qSrr0r`r_rrr-s csg|]}|jkr|qSrr))r&vir_rrr-s N_zGraph combining  and z )r5rr6CopyFromadd_prefix_graphrrrrYr Z Extractorr make_modelZ extract_modelrr9joinrextendr/r4r.r*r>)r r r r:r;r<r=r*r>Zg1_copyZg2_copyZg1_outsZg2_insZ g1_inputsZ g2_inputsZ g1_outputsZ g2_outputse1e2Z g1_out_nameZ g2_in_nameZoverlapping_namescategorynamesrXZg2_nodes_beginZ g2_nodes_endr)r]rIrKrJrLr<r=r^r merge_graphsXs&          ((          "  rnonnx.compose.merge_models1.0rr%rz int | None)m1m2r r:r;r<r=r*r> producer_nameproducer_versiondomain model_versionrc  sBt|tk rtdt|tk r(td|j|jkrNtd|jd|jd|j} i}t|jt|j}|D]H}|j|kr||j}|j|krtd|jd|jqp|j||j<qpsĈr"rt}|||}t |d}rt}|||}t |d}fd d |D}t |j |j |||||d }t j || | | | || d }i}|jD]}|j||j<q^|jD]V}|j|kr||j}||jkrtd |jd|d|jdn |j||j<qxt ||tdd|jDdd|jD@}|rtdd||j|j|j|jt||S)a=Combines two ONNX models into a single one. The combined model is defined by connecting the specified set of outputs/inputs. Those inputs/outputs not specified in the io_map argument will remain as inputs/outputs of the combined model. Both models should have the same IR version, and same operator sets imported. Arguments: m1 (ModelProto): First model m2 (ModelProto): Second model io_map (list of pairs of string): The pairs of names [(out0, in0), (out1, in1), ...] representing outputs of the first graph and inputs of the second to be connected inputs (list of string): Optional list of inputs to be included in the combined graph By default, all inputs not present in the ``io_map`` argument will be included in the combined model outputs (list of string): Optional list of outputs to be included in the combined graph By default, all outputs not present in the ``io_map`` argument will be included in the combined model prefix1 (string): Optional prefix to be added to all names in m1 prefix2 (string): Optional prefix to be added to all names in m2 name (string): Optional name for the combined graph By default, the name is g1.name and g2.name concatenated with an undescore delimiter doc_string (string): Optional docstring for the combined graph If not provided, a default docstring with the concatenation of g1 and g2 docstrings is used producer_name (string): Optional producer name for the combined model. Default: 'onnx.compose' producer_version (string): Optional producer version for the combined model. Default: "1.0" domain (string): Optional domain of the combined model. Default: "" model_version (int): Optional version of the graph encoded. Default: 1 Returns: ModelProto z m1 argument is not an ONNX modelz m2 argument is not an ONNX modelzIR version mismatch z != z-. Both models should have the same IR versionzPCan't merge two models with different operator set ids for a given domain. Got: rdr?cs<g|]4}r|dn|dr.|dn|dfqSrArrBrDrrr-rsz merge_models..)r:r;r*r>)rsrtrurv opset_imports ir_versionzaCan't merge models with different values for the same model metadata property. Found: property = z, with values .cSsh|] }|jqSrr))r&frrrr(szmerge_models..zPCan't merge models with overlapping local function names. Found in both graphs: rN)r5rr6rxrZ opset_importruversionre add_prefixrnrr rgZmetadata_propsvaluekeyZset_model_props functionsrhZ MergeFromrZ check_model)rqrrr r:r;r<r=r*r>rsrtrurvrxZopset_import_maprwentryZ found_versionZm1_copyZm2_copyrmodelZ model_propsZ meta_entryr}Zfunction_overlaprrDr merge_modelss1                     rTFstrz bool | Nonezdict[str, str] | None) rr@ rename_nodes rename_edges rename_inputsrename_outputsrename_initializersrename_value_infosinplacename_maprc Cst|tk rtd|s*t} | |n|} dddddd} | dkrLi} |r| jD]8} | jD]} | || | | <q`| jD]} | || | | <qzqV|r| jD]}| ||j| |j<q|r| jD]}| ||j| |j<q|r| jD]6} | || j| _| jD]}|j rt |j |d| dqq|rx| j D]}| ||j| |j<q$| j D]2}| ||j j| |j j<| ||jj| |jj<qD|r| jD]}| ||j| |j<q| jD]n} t| jD](\}}| j|| kr| || j|<qt| jD](\}}| j|| kr| || j|<qq| jD]}|j| kr| |j|_q| jD]}|j| kr@| |j|_q@| j D]}|j| krf| |j|_qf| j D]B}|j j| kr| |j j|j _|jj| kr| |jj|j_q| jD]}|j| kr| |j|_q| S) aAdds a prefix to names of elements in a graph: nodes, edges, inputs, outputs, initializers, sparse initializer, value infos. It can be used as a utility before merging graphs that have overlapping names. Empty names are not prefixed. Arguments: graph (GraphProto): Graph prefix (str): Prefix to be added to each name in the graph rename_nodes (bool): Whether to prefix node names rename_edges (bool): Whether to prefix node edge names rename_inputs (bool): Whether to prefix input names rename_outputs (bool): Whether to prefix output names rename_initializers (bool): Whether to prefix initializer and sparse initializer names rename_value_infos (bool): Whether to prefix value info names inplace (bool): If True, mutates the graph directly. Otherwise, a copy will be created name_map: (Dict): shared name_map in subgraph Returns: GraphProto #graph argument is not an ONNX graphr)r@r*rcSst|dkr||S|SrU)rY)r@r*rrr _prefixedsz#add_prefix_graph.._prefixedNT)rr)r5rr6rerrrr*rWrXrfr/r4r1r3r.rZ)rr@rrrrrrrrrXrr r,rrWraZ sparse_initr!rZinput_Zin_descZout_descr/r4r.rrrrfs"                        rf) rr@rrrrrrrename_functionsrrc  Cst|tk rtd| s,t} | || }t|j|||||||dd |ri} |jD]} || j} | | | j<| | _qV|jD]&} | jD]}|j | kr| |j |_ qq||jjD]}|j | kr| |j |_ q|S)aAdds a prefix to names of elements in a graph: nodes, edges, inputs, outputs, initializers, sparse initializer, value infos, and local functions. It can be used as a utility before merging graphs that have overlapping names. Empty names are not _prefixed. Arguments: model (ModelProto): Model prefix (str): Prefix to be added to each name in the graph rename_nodes (bool): Whether to prefix node names rename_edges (bool): Whether to prefix node edge names rename_inputs (bool): Whether to prefix input names rename_outputs (bool): Whether to prefix output names rename_initializers (bool): Whether to prefix initializer and sparse initializer names rename_value_infos (bool): Whether to prefix value info nanes rename_functions (bool): Whether to prefix local function names inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: ModelProto #model argument is not an ONNX modelT)rrrrrrr) r5rr6rerfrrr*rZop_type)rr@rrrrrrrrmZ f_name_maprzZ new_f_namer rrrr|"s>"           r|rP)rdim_idxrrc Cst|tk rtd|s*t}||n|}dd|jD}|jD]d}t|jD]$\}}||krR|d||j|<qRt|jD]$\}}||kr|d||j|<qqD|jd} |j t j dg| g| dt j | dt jd g|gd d tt|jD]} |jd } | jd|} |j t j d | | g| jgd| jddd| jjjjD} | |d |j t | j| jjj| q|S)aEInserts an extra dimension with extent 1 to each output in the graph. Inserts an Unsqueeze node for each output. It can be used as a utility before merging graphs, for example when the second one expects a batch dimension. Arguments: graph (GraphProto): Graph dim_idx (int): Index of the dimension to be inserted. A negative value means counting dimensions from the back. inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: GraphProto rcSsg|] }|jqSrr))r&rrrrr-sz(expand_out_dim_graph..Z_collapsed_dim_Z_expand_out_dim_idxConstantz -constantz-valuer%)r*Z data_typeZdimsvals)r:r;r*r}rZ Unsqueezez unsqueeze-)r:r;r*cSsg|] }|jqSr)Z dim_value)r&drrrr-s)r5rr6rerrrZrr*rr Z make_nodeZ make_tensorrZINT64rVrYpopZ tensor_typeshapeZdiminsertZmake_tensor_value_infoZ elem_type)rrrrXZorig_out_namesr r!outinpZ expand_dim_krcr"Z prev_outputZ new_shaperrrexpand_out_dim_graphlsh       r)rrrrcCs@t|tk rtd|s,t}|||}t|j|dd|S)aEInserts an extra dimension with extent 1 to each output in the graph. Inserts an Unsqueeze node for each output. It can be used as a utility before merging graphs, for example when the second one expects a batch dimension. Arguments: model (ModelProto): Model dim_idx (int): Index of the dimension to be inserted. A negative value means counting dimensions from the back. inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: ModelProto rT)r)r5rr6rerr)rrrrrrrexpand_out_dims  r)N)NNNNNN) NNNNNNrorprr%)TTTTTTFN)TTTTTTTF)F)F) __future__rtypingrZonnxrrrrrr r r9rnrrfr|rrrrrrs\  $ I"H*$x$MS