CasperSecurity
o
`�wiQ_ � @ s
d Z ddlZddlZddlZddlZddlZddlZddlZej d Z
ej d Z ej d Z ej d Z
e e
fZejZdZdZdZd Zd
Zd Zd Zi Zd
d� Zi Zdd� Zddd�ZG dd� d�Z G dd� d�Z dd� Z e dkr�ze � Z W dS e!y� e"d� Y dS w dS ) z3Find modules used by a script, using introspection.� N�
LOAD_CONST� IMPORT_NAME�
STORE_NAME� STORE_GLOBAL� � � � � � c C s t �| g ��|� d S �N)�packagePathMap�
setdefault�append)� packagename�path� r �#/usr/lib/python3.10/modulefinder.py�AddPackagePath& s r c C s |t | < d S r )�replacePackageMap)�oldname�newnamer r r �ReplacePackage1 s r c C s t jj�� t jj�| |�}|du r tdj| d�| d��|jt jju r+ddddt ffS |jt jj
u r:ddddt ffS |j }|j�
| �rOdtj�|�ddtffS t|jt jj�rZt}n t|jt jj�ret}nt|jt jj�rpt}nddddtffS t�|�}tj� |�d }|||d|ffS )zDAn importlib reimplementation of imp.find_module (for our purposes).NzNo module named {name!r})�name� ����rb) � importlib� machinery�
PathFinder�invalidate_caches� find_spec� ImportError�format�loader�BuiltinImporter�
_C_BUILTIN�FrozenImporter�
_PY_FROZEN�origin�
is_package�osr �dirname�_PKG_DIRECTORY�
isinstance�SourceFileLoader�
_PY_SOURCE�ExtensionFileLoader� _C_EXTENSION�SourcelessFileLoader� _PY_COMPILED�
_SEARCH_ERROR�io� open_code�splitext)r r �spec� file_path�kind�file�suffixr r r � _find_module5 s*
r> c @ s e Zd Zddd�Zdd� ZdS )�ModuleNc C s( || _ || _|| _d | _i | _i | _d S r )�__name__�__file__�__path__�__code__� globalnames� starimports)�selfr r< r r r r �__init__d s
zModule.__init__c C sL d| j f }| jd ur|d| jf }| jd ur |d| jf }|d }|S )Nz Module(%rz, %r�))r@ rA rB )rF �sr r r �__repr__q s
zModule.__repr__)NN)r@ �
__module__� __qualname__rG rJ r r r r r? b s
r? c @ s� e Zd Zd6dd�Zdd� Zdd� Zd d
� Zd d � Zd
d� Zd7dd�Z d8dd�Z
dd� Z dd� Z d9dd�Z
dd� Zd d � Zd d � Zd d!� Zd8d"d#�Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zd:d,d-�Zd.d/� Zd0d1� Zd2d3� Zd4d5� ZdS );� ModuleFinderNr c C sZ |d u rt j}|| _i | _i | _|| _d| _|d ur |ng | _|d ur%|ng | _g | _d S )Nr ) �sysr �modules�
badmodules�debug�indent�excludes�
replace_paths�processed_paths)rF r rQ rS rT r r r rG | s
zModuleFinder.__init__c G sZ || j kr+t| j�D ]}tddd� q
t|dd� |D ]
}tt|�dd� qt� d S d S )N� � ��end)rQ �rangerR �print�repr)rF �level�str�args�i�argr r r �msg� s
�zModuleFinder.msgc G s0 |d }|| j kr| jd | _| j|� d S d S �Nr r �rQ rR rb �rF r_ r] r r r �msgin� �
�zModuleFinder.msginc G s0 |d }|| j kr| jd | _| j|� d S d S rc rd re r r r �msgout� rg zModuleFinder.msgoutc C sX | � dd|� t�|��}ddtf}| �d|||� W d � d S 1 s%w Y d S )Nr �
run_scriptr r �__main__)rb r6 r7 r0 � load_module)rF �pathname�fp�stuffr r r ri � s
"�zModuleFinder.run_scriptc C sj t j�|�\}}t j�|�\}}t�|��}|dtf}| �||||� W d � d S 1 s.w Y d S )Nr )r+ r �splitr8 r6 r7 r0 rk )rF rl �dirr �extrm rn r r r � load_file� s
"�zModuleFinder.load_filer c C s\ | � dd||||� | j||d�}| �||�\}}| �||�}|s#|S |jr,| �||� d S )Nr � import_hook�r] )rb �determine_parent�find_head_package� load_tailrB �ensure_fromlist) rF r �caller�fromlistr] �parent�q�tail�mr r r rs � s zModuleFinder.import_hookc C sJ | � dd||� |r|dkr| �dd� d S |j}|dkrb|jr$|d8 }|dkr<| j| }||u s3J �| �dd|� |S |�d�|k rGtd��d�|�d�d | � �}| j| }| �dd|� |S |jry| j| }||u spJ �| �dd|� |S d|v r�|� d�}|d |� }| j| }|j|ks�J �| �dd|� |S | �dd� d S ) N� ru r zdetermine_parent -> Noner zdetermine_parent ->�.z relative importpath too deep)
rf rh r@ rB rO �countr" �joinro �rfind)rF ry r] �pnamer{ r` r r r ru � sB
z ModuleFinder.determine_parentc C s� | � dd||� d|v r |�d�}|d |� }||d d � }n|}d}|r.d|j|f }n|}| �|||�}|rF| �dd||f� ||fS |rb|}d }| �|||�}|rb| �dd||f� ||fS | �dd|� td | ��)
Nr rv r� r r �%s.%szfind_head_package ->�"raise ImportError: No module named�No module named )rf �findr@ �
import_modulerh r" )rF r{ r r` �headr} �qnamer| r r r rv � s.
z ModuleFinder.find_head_packagec C s� | � dd||� |}|rG|�d�}|dk rt|�}|d |� ||d d � }}d|j|f }| �|||�}|sE| �dd|� td| ��|s | �dd |� |S )
Nr rw r� r r r� r� r� z load_tail ->)rf r� �lenr@ r� rh r" )rF r| r} r~ r` r� �mnamer r r rw � s
� zModuleFinder.load_tailc C s� | � dd|||� |D ]2}|dkr"|s!| �|�}|r!| �||d� q t||�s=d|j|f }| �|||�}|s=td| ��q d S )Nr rx �*r r� r� )rb �find_all_submodulesrx �hasattrr@ r� r" )rF r~ rz � recursive�sub�all�subname�submodr r r rx s
�
��z ModuleFinder.ensure_fromlistc
C s� |j sd S i }g }|tjjd d � 7 }|tjjd d � 7 }|tjjd d � 7 }|j D ]F}zt�|�}W n tyC | � dd|� Y q*w |D ])}d }|D ]}t
|�} || d � |krd|d | � } nqL|ro|dkro|||< qFq*|� � S )Nr zcan't list directoryrG ) rB r r �EXTENSION_SUFFIXES�SOURCE_SUFFIXES�BYTECODE_SUFFIXESr+ �listdir�OSErrorrb r� �keys)
rF r~ rO �suffixesrp �namesr �mod�suff�nr r r r� s6
�� �� z ModuleFinder.find_all_submodulesc C s | � dd|||� z| j| }W n ty Y n
w | �dd|� |S || jv r0| �dd� d S |r?|jd u r?| �dd� d S z| �||oG|j|�\}}}W n ty_ | �ddd � Y d S w z| �||||�}W |rp|� � n|rx|� � w w |r�t
|||� | �dd|� |S )Nr r� zimport_module ->zimport_module -> None) rf rO �KeyErrorrh rP rB � find_moduler" rk �close�setattr)rF �partname�fqnamer{ r~ rm rl rn r r r r� , sD �
� ���
� zModuleFinder.import_modulec
C s |\}}}| � dd||o
d|� |tkr#| �||�}| �dd|� |S |tkr0t|�� |d�} n9|tkrgz|�� }
tj �
|
|i � W n t yZ } z | �ddt | � |� � d } ~ ww t
�t|
�dd � �} nd } | �|�}||_| r�| jr{| �| �} | |_| �| |� | �dd|� |S )Nr rk rm zload_module ->�execzraise ImportError: � )rf r- � load_packagerh r0 �compile�readr4 r �_bootstrap_external�
_classify_pycr" r^ �marshal�loads�
memoryview�
add_modulerA rT �replace_paths_in_coderC � scan_code) rF r� rm rl � file_infor= �mode�typer~ �co�data�excr r r rk L s8
��
zModuleFinder.load_modulec C s> || j vr
i | j |< |rd| j | |j< d S d| j | d< d S )Nr �-)rP r@ )rF r ry r r r �_add_badmodulei s
zModuleFinder._add_badmodulec C sJ || j v r
| �||� d S z
| j|||d� W nC ty9 } z| �ddt|�� | �||� W Y d }~d S d }~w tyZ } z| �ddt|�� | �||� W Y d }~d S d }~ww |r�|D ]C}|d | }|| j v rs| �||� q_z | j|||g|d� W q_ ty� } z| �ddt|�� | �||� W Y d }~q_d }~ww d S d S )Nrt r z ImportError:z SyntaxError:r� )rP r� rs r" rb r^ � SyntaxError)rF r ry rz r] rb r� �fullnamer r r �_safe_import_hookq s:
���
���z ModuleFinder._safe_import_hookc c s� � |j }|j}|j}dd� t�|�D �}t|�D ]`\}\}}|tv r+d|| ffV q|tkrx|dkrx||d d ||d d krItkrxn q|||d d } |||d d }
| dkrmd|
|| ffV n
d| |
|| ffV qqd S ) Nc S s" g | ]
\}}}|t kr||f�qS r )� EXTENDED_ARG)�.0�_�opra r r r �
<listcomp>� s �z-ModuleFinder.scan_opcodes.<locals>.<listcomp>�storer r r �absolute_import�relative_import) �co_code�co_names� co_consts�dis�_unpack_opargs� enumerate� STORE_OPSr r ) rF r� �coder� �consts�opargsr` r� �opargr] rz r r r � scan_opcodes� s& �0��zModuleFinder.scan_opcodesc C s| |j }| j}||�D ]�\}}|dkr|\}d|j|< q
|dkr~|\}}d} |d ur6d|v r/d} dd� |D �}| j|||dd� | r}d }
|jrQ| j�|jd | �}
|
d u r[| j�|�}
|
d urx|j�|
j� |j �|
j � |
j
d u rwd|j |< q
d|j |< q
|d
kr�|\} }}|r�| j|||| d� q
| j || d�} | j| jd |dd� q
t |��|j
D ]}
t|
t|��r�| �|
|� q�d S ) Nr� r r� r r� c S s g | ]}|d kr|�qS )r� r )r� �fr r r r� � s z*ModuleFinder.scan_code.<locals>.<listcomp>rt r� r� )r� r� rD r� rB rO �getr@ �updaterE rC ru � RuntimeErrorr� r. r� r� )rF r� r~ r� �scanner�whatr_ r rz � have_star�mmr] r{ �cr r r r� � sP
�
�
��zModuleFinder.scan_codec C s� | � dd||� t�|�}|r|}| �|�}||_|g|_|jt�|g � |_| �d|j�\}}}z| �||||� | � dd|� |W |rJ|�
� S S |rR|�
� w w )Nr r� rG zload_package ->) rf r r� r� rA rB r
r� rk rh r� )rF r� rl r r~ rm �bufrn r r r r� � s$
�
�zModuleFinder.load_packagec C s* || j v r
| j | S t|� | j |< }|S r )rO r? )rF r� r~ r r r r� � s
zModuleFinder.add_modulec C sn |d ur |j d | }n|}|| jv r | �dd|� t|��|d u r2|tjv r/d d ddtffS | j}t||�S )Nr� r zfind_module -> Excludedr ) r@ rS rh r" rN �builtin_module_namesr& r r> )rF r r r{ r� r r r r� � s
zModuleFinder.find_modulec C s t � t dd � t dd � t| j�� �}|D ]!}| j| }|jr)t ddd� nt ddd� t d| |jp7d � q| �� \}}|rat � t d
� |D ]}t| j| �� �}t d |d d
�|�� qK|r�t � t ddd� t d� |D ]}t| j| �� �}t d |d d
�|�� qrdS dS )z�Print a report to stdout, listing the found modules with their
paths, as well as modules that are missing, or seem to be missing.
z
%-25s %s)�Name�File)�----r� �PrW rX r~ z%-25sr zMissing modules:�?z
imported fromz, z7Submodules that appear to be missing, but could also bez#global names in the parent package:N) r[ �sortedrO r� rB rA �any_missing_mayberP r� )rF r� �keyr~ �missing�mayber �modsr r r �report� s4
�zModuleFinder.reportc C s | � � \}}|| S )z�Return a list of modules that appear to be missing. Use
any_missing_maybe() if you want to know which modules are
certain to be missing, and which *may* be missing.
)r� )rF r� r� r r r � any_missing s zModuleFinder.any_missingc C s� g }g }| j D ]V}|| jv rq|�d�}|dk r |�|� q||d d� }|d|� }| j�|�}|durX|| j | v rC|�|� q||jv rIq|jrR|�|� q|�|� q|�|� q|�� |�� ||fS )a� Return two lists, one with modules that are certainly missing
and one with modules that *may* be missing. The latter names could
either be submodules *or* just global names in the package.
The reason it can't always be determined is that it's impossible to
tell which names are imported when "from module import *" is done
with an extension module, short of actually importing it.
r� r r N) rP rS r� r rO r� rD rE �sort)rF r� r� r r` r� �pkgname�pkgr r r r� ( s0
z ModuleFinder.any_missing_maybec C s� t j�|j� }}| jD ]\}}|�|�r!||t|�d � } nq | jrH|| jvrH||kr9| � dd||f � n | � dd|f � | j�
|� t |j �}t
t|��D ]}t|| t|��rg| �|| �||< qS|jt|�|d�S )Nr z co_filename %r changed to %rz co_filename %r remains unchanged)r� � co_filename)r+ r �normpathr� rT �
startswithr� rQ rU rh r �listr� rZ r. r� r� �replace�tuple)rF r� � new_filename�original_filenamer� �rr� r` r r r r� V s*
���
�z"ModuleFinder.replace_paths_in_code)Nr NN)NNr )r )r r ) r@ rK rL rG rb rf rh ri rr rs ru rv rw rx r� r� rk r� r� r� r� r� r� r� r� r� r� r� r r r r rM z s4
#
1
" .rM c
C s� dd l } z| � tjdd � d�\}}W n | jy+ } z t|� W Y d }~d S d }~ww d}d}g }g }|D ]-\}} |dkrB|d }|dkrHd}|dkrT|| �tj� }|dkrZd}|dkrc|�| � q6|sid }
n|d }
tj d d � } tj �
|
�| d< || } |dkr�td
� | D ] } td t | �� q�t | ||�}
|dd � D ]+}|dkr�d}q�|r�|d d � d
kr�|
�
|d d � d dg� q�|
�
|� q�|
�|� q�|
�|
� |
�� |
S )Nr r zdmp:qx:z-dz-mz-pz-qz-xzhello.pyzpath:rV ���z.*r� )�getoptrN �argv�errorr[ ro r+ �pathsepr r r, r\ rM rs rr ri r� )r� �optsr_ rb rQ �domods�addpath�exclude�o�a�scriptr �item�mfra r r r �testn s^ ��
�
r rj z
[interrupted]r )#�__doc__r� � importlib._bootstrap_externalr �importlib.machineryr� r+ r6 rN �opmapr r r r r� r� r5 r0 r4 r2 r- r& r( r
r r r r> r? rM r r@ r �KeyboardInterruptr[ r r r r �<module> sN
- w; ��