U qh9@sddlmZddlZddlmZmZmZmZm Z m Z m Z ddl m Z mZmZmZmZmZmZmZmZddlmZdddd d d d Zd d dddZd dd dddZdddddddddZdS)) annotationsN)AttributeProto FunctionProto GraphProto ModelProto NodeProtoSparseTensorProto TensorProto) make_attribute make_function make_graph make_model make_node make_tensormake_tensor_value_infoset_model_propstensor_dtype_to_np_dtype) from_arrayrintfloatzlist[NodeProto])node thresholdvalue_constant_of_shapereturnc Cs|jdkrtd|jd|jD]}|jdkrBtd|jd|jdkr|j}|jd}|j}t|}||kr|gSt tj t |tj d |d }t |j} tdg|g|d } td |g|jt tj |g| d d } | | gStd |jq"|gS)zReplaces a Constant node with a large tensor (with more than threshold elements) by a sequence of nodes that produces a dummy constant of same shape as original tensor.Constantz!Node type must be 'Constant' not .Z sparse_valuezEThis feature is not yet implemented for a sparse constant (node name=).value__SHAPEdtypenamerConstantOfShapez'Replacement of constant with attribute )op_type TypeError attributer"NotImplementedErrortdimsnpprodrarraylistint64r data_typeroutput) rrrattrnew_namer*sizeinitr Z node_shapenew_noder7@/tmp/pip-unpacked-wheel-xnis5xre/onnx/tools/replace_constants.py_replace_constantsB           r9zGraphProto | FunctionProto)onxrcst|trt|j}n*t|tr,t|j}ntdt|dt|D] }t|jOt|j OqJfdd}t dg|dgdd}t dg|d gd d}i}t |D]*\}}|j d krq|jd}t d |g||d g} t d|j d| j d|j dg||dg} t |jd kr:|jdjj} ntj} t d| j dg||dg| d} t d| j dg||dg| d} t d| j d| j dg||dg}t d|j d|g|j }| | | | ||g||<qt|ddD]\}}||||d <q|d||d |t|trPt||j|j|j |j|jd}|St|tr~t|j|j|j|j ||jd}|Stdt|ddS)zReplaces all *ConstantOfShape* by node *Range* to avoid constant tensors. The function is not recursive. The recursivity is done by *replace_initializer_by_constant_of_shape*. Not implemented for type rcsT|kr||Sd}|d|}|kr>||S|d7}qtddS)N_z/The function should never go through that line.)add RuntimeError)prefixir"existing_namesr7r8 _find_name[s   z9_replace_constant_of_shape_with_range.._find_namerZzeror)Z value_intZoner>r$Z ReduceProdZ_NZRangeZ_RANGEZCastZ_RANGEf)toZ_NfZDivZ_FLATZReshapeT)reverse initializersparse_initializerZ opset_importsN) isinstancerr.rrr&typesetinputr1r enumerater%lenr'r)r0r FLOATsorteditemsinsertr r"rIrJr domain opset_import)r:nodesrrEZcst0Zcst1updateinodeshapenarFacZcldZreshupgraphnew_onxr7rCr8%_replace_constant_of_shape_with_rangeGsx       $$    rc)r:rrcCsvt|trt|j}n*t|tr,t|j}ntdt|dt}|D] }|t|jO}|t|j O}qJi}t |D]n\}}|j dkrqx|j dj }t|j|jdg|g}td|j|j } t|j dj|d} | j | | ||<qx|D]\}} | ||<qt|tr0t||j|j|j |j|jd} | St|tr^t|j|j|j|j ||jd} | Stdt|dd S) z7Replaces all fill value of all nodes *ConstantOfShape*.r;rr$rr>r#rHrKN)rLrr.rrr&rMrNrOr1rPr%r'r)rr"r0rr appendrTr rIrJr rVrW)r:rrXrDrrYrZZtensorZ new_tensorr6r2r`rarbr7r7r8 _replace_constant_of_shape_values^           reF?z'FunctionProto | GraphProto | ModelProtoz int | Nonebool)r:r ir_version use_rangerc sttrd}g}jD]@}|jdkrNt|}t|dkrBd}||q||q|rtj j j j |j d} rt| Sdkrt| S| SrtSdkrtSSttrtjpڈjd} fdd jD} t| | jjpjjj jd } tjd krVd d jD} t| | | j dd=j D]z}| j }|j dkr|jdkrrtd|jd|j dkr|jdkrtd|jd|j |_ |j|_qh| Sttst dt!dd }g}t"g}g}j#D]}t$|j%}t&'|}|krT||q$|d7}|j d}|t(t&j)t*|t&j+d|dt,|j-}t.d|g|j gt(t&j)dg|dd}|||j dk r$dkr$|t/|t0j1t|gq$g}j2D]P}t$|j%}t&'|}|kr<||q t3d|j4j d|j5j dq jD]}|jdkrt|}t|dkr|d7}||qdd}g}|j6D]n}|j!t7j8krt9|d r|j:dk rt|j:d!}t;|t;|j:krd}t<|j |}||q|r\t.|j|j |j }|j6||||d7}n ||qd|d krt=|j fd"d j D|j ||d#}rt|Sdkrt|S|SrtSdkrtSS)$aReplace initializers or constant node by nodes *ConstantOfShape* to reduce the size. This reduce the cost to write a unit test about a specific graph structure. Args: onx: ModelProto threshold: every initializer under this threshold is not impacted ir_version: initializer must be specified as input for `ir_version <= 3`, this must be specified if onx is :class:`FunctionProto` or :class:`GraphProto` use_range: if uses operator *Range* instead of *ConstantOfShape* to avoid constant tensors value_constant_of_shape: value to use as a value for all nodes *ConstantOfShape*, a high value may produce nan or inf predictions Returns: onx, modified ModelProto The function is designed so that the function can be reapplied on a modified model and either replace *ConstantOfShape* with *Range* operators, either replace the fill value for every *ConstantOfShape*. Frr<TrKr>)rirrjrc s$g|]}t|pjdqS)rrirjr)(replace_initializer_by_constant_of_shaperi).0f)rir:rrjrr7r8 sz.) functions producer_nameproducer_versionri doc_stringrV model_versionrcSsi|]}|j|jqSr7)keyr)rmpr7r7r8 3sz.N z.Range was introduced in opset 11 but opset is r z7ConstantOfShape was introduced in opset 9 but opset is z-onx should be a GraphProto at this stage not rrr!r$rgr#zKThis feature is not yet implemented for a sparse initializer (indices.name=z, values.name=rgrkcsg|]}|jkr|qSr7r!)rmrB)removedr7r8ros rH)>rLrrr%r9rQextendrdr rVr"rOr1rWrcrerrlrarirpr rqrrrsrtZmetadata_propsrr?versionr@rr&rMrNrItupler*r+r,rr-r.r/rr0rrr ZINT64rJr(indicesvaluesr'rZGRAPHhasattrr|idr r ) r:rrirjrmodifiedZ new_nodesrZ cst_nodesrbZ new_graphZ new_functionsmodelrZoimpZop_setZn_modificationsZadditional_inputsZ new_initsr5r*r4r3r Znew_sparse_initsZsp_initZ shape_nodesZattsr2r|r6rar7)rir:r}rrjrr8rlsH                                                 rl)rfNFrg) __future__rZnumpyr+Zonnxrrrrrrr Z onnx.helperr r r r rrrrrZonnx.numpy_helperrr9rcrerlr7r7r7r8s $ , (X9