File: //lib/python3.6/site-packages/cloudinit/cmd/__pycache__/main.cpython-36.pyc
3
�q�h͉ � @ sD d dl Z d dlZd dlZd dlZd dlZd dlZd dlmZ d dlm Z d dl
m Z e j � d dl
mZ d dlmZ d dlmZ d dlmZ d d lmZ d d
lmZ d d lmZ d d lmZ d d
lmZ d dlmZ d dlmZ d dlmZ d dl m Z m Z m Z m Z d dlm!Z! d dl"m#Z# d dl$m%Z% dZ&dZ'e e e d�Z(ej)e*�Z+dHdd�Z,dIdd �Z-d d � Z.d d � Z/e d!�d"d#�Z0d$d%� Z1dKd(d)�Z2dLee3e4f d+�d,d-�Z5d.d/� Z6d0d1� Z7d2d3� Z8d4d5� Z9d6d7� Z:d8d9� Z;dMd:d;�Z<ej=d<�d=d>�Z>d?d@� Z?dAdB� Z@dNdCdD�ZAe*dEk�r@dFejBk�r&dGejBdF< eAejC�ZDeD�r@ejEeD� dS )O� N)�Tuple)�patcher)�Modules)�validate_cloudconfig_schema)�log)�netinfo)�signal_handler)�sources)�stages)�
url_helper)�util)�version)�warnings)� reporting)�events)� PER_INSTANCE�
PER_ALWAYS�PER_ONCE� CLOUD_CONFIG)�
atomic_helper)�cc_set_hostname)�read_cfg_pathszOCloud-init v. {version} running '{action}' at {timestamp}. Up {uptime} seconds.zcloud_%s_modules)�instance�always�once� c C s^ | rt jjd| � t jjdd � t jjd� tjt jd� t jjdd � t jjd� d S )Nz%s
�-�< �
)�file)�sys�stderr�write� traceback� print_exc)�msg� r& �/usr/lib/python3.6/main.pyr$ K s r$ c C s& |s t | �}tjd| ddtd� |S )Nz%s
FT)Zconsoler! r )�welcome_formatr Z multi_log�LOG)�actionr% r& r& r' �welcomeU s r+ c C s t jtj� tj� tj� | d�S )N)r
�uptimeZ timestampr* )�WELCOME_MSG_TPL�formatr
�version_stringr r, Z time_rfc2822)r* r& r& r' r( \ s
r( c C s2 g }| j r.x"| j D ]}|jtjj|j�� qW |S )N)�files�append�os�path�realpath�name)�argsZfn_cfgsZfhr& r& r' � extract_fnse s
r7 )�modsc C sv t | }| j|�\}}t|�t|� }|dkrXd||f }tjjd| � tj|� g S tjdt|�t|�� |S d S )Nr z)No '%s' modules to run under section '%s'z%s
z Ran %s modules with %s failures)�MOD_SECTION_TPLZ run_section�lenr r! r" r) �debug)r8 � action_nameZsectionZfull_section_name� which_ran�failuresZtotal_attemptedr% r& r& r' �run_module_sectionr s
r? c C s | j d�rtj| j d�� d S )Nr )�getr Zupdate_configuration)�cfgr& r& r' �apply_reporting_cfg� s
rB �cloud-config-url�urlc C s@ t j| �}x |D ]}||kr||| fS qW td| |f ��d S )Nz!No keys (%s) found in string '%s')r Zkeyval_str_to_dict�KeyError)�cmdline�names�data�keyr& r& r' �parse_cmdline_url� s
rJ T)�returnc C s& |dkrt j� }yt|�\}}W n tk
r: tjdfS X |jd�pN|jd�}|r�tjj | �r�|r�d| |f }tj
}|r�tj}nd| |f }tj }||fS |ddd d
�}|s�|r�tj }d |d < ntj}d
|d < d} d}
y�t j
f |�} d} | j� �r�d }
t| t j��rLy | t| jt|
�d��7 } W n tk
�r8 Y nX | j|
��s^d}
n| jj|
��s^d}
|
�r�|dk�r�t jdddd� n0|dk�r�tj }ntj
}|d|� dt|
�� �fS n|d|| jf fS | | j } W n0 t jk
�r } z|d||f fS d}~X nX t j| | d d � tj
d ||| f fS ) a� Write data from url referenced in command line to path.
path: a file to write content to if downloaded.
network: should network access be assumed.
cmdline: the cmdline to parse for cloud-config-url.
This is used in MAAS datasource, in "ephemeral" (read-only root)
environment where the instance netboots to iscsi ro root.
and the entity that controls the pxe config has to configure
the maas datasource.
An attempt is made on network urls even in local datasource
for case of network set up in initramfs.
Return value is a tuple of a logger function (logging.DEBUG)
and a message indicating what happened.
Nz!No kernel command line url found.zfile://�/z_file '%s' existed, possibly from local stage download of command line url '%s'. Not re-writing.zafile '%s' existed, possibly from previous boot download of command line url '%s'. Not re-writing.�
� T)rD ZtimeoutZretries�stream� Z sec_betweeng�������?s
#cloud-config� )Z
chunk_sizeFrD z!The kernel command line key `url`z22.3zD Please use `cloud-config-url` kernel command line parameter instead)Z
deprecatedZdeprecated_versionZ
extra_messagezcloud-config-urlz
contents of 'z' did not start with z$url '%s' returned code %s. Ignoring.z retrieving url '%s' failed: %si� )�modez*wrote cloud-config data from %s='%s' to %s)r Z get_cmdlinerJ rE �logging�DEBUG�
startswithr2 r3 �exists�INFO�WARNr Zread_file_or_url�ok�
isinstanceZ UrlResponse�nextZ iter_contentr: �
StopIteration�contentsZ deprecate�str�codeZUrlError�
write_file)r3 �networkrF Z cmdline_namerD Z
path_is_local�m�level�kwargsrH �headerZrespZsniffed_contentZ is_cloud_cfg�er& r& r' �attempt_cmdline_url� sz
rg c C s� dt jjt jjf }tjj| jjd�d�}tjj |�rlt
|�j � }||kr�t j
d� | jd� tj||� n*tjj | jjd��r�t jd� tj||� dS ) z�Purge the cache if python version changed on us.
There could be changes not represented in our cache (obj.pkl) after we
upgrade to a new version of python, so at that point clear the cache
z%d.%drH zpython-versionz-Python version change detected. Purging cacheTZobj_pklzMWriting python-version file. Cache compatibility status is currently unknown.N)r � version_info�major�minorr2 r3 �join�paths� get_cpathrV �open�readr) r; � purge_cacher r` �
get_ipath_cur�info)�initZcurrent_python_versionZpython_version_pathZcached_python_versionr& r& r' �$purge_cache_on_python_version_change� s
rt c C s t j| jd�rdS |j S )NZdisable_network_activationF)r �get_cfg_option_boolrA �local)rs r6 r& r& r' �_should_bring_up_interfaces s rw c - C s� t jt jg}|jrt jg}ttjjdt d�|j d�g}|jsJt | �}n t d| �}t
j ||j d�}|j
t|�� d }d }y.|jtjdf� tj� tj|j| �\}}W n< tk
r� d}tjt|� t|� |jtj|f� Y nX |j�rtjd� tj � tj |j� t |j� t | |d � x |D ]\} }tj | |� �q*W y |j!� W n" tk
�rr tjtd
� Y nX |j"}
t#|� |j�r�t j$nt j%} | t j%k�r�d } t&j'j(d t)j*� � nZd
} tj+|jdd�}
|
�r�tjd� d } n(|
j,d�}tjj-|��rtjd|� d } |j.� t/||�}yB|j0| d� | t j%k�r`|j1j2| k�r`tjd| |j1� d g fS W n� t j3k
�r� | t j$k�r�tjd� n tjtd� |j4�s�|j5|d� tjd| � | t j$k�r�d g fS d dgfS n tjd| � Y nX t6|� |j7� }tjd| | ||j8� � | t j$k�r,t9|d d d � |j5|d� | t j$k�r||j1j2| k�rltjd | |j1� |j1g fS tjd | |j1� |j:� |j;� t9|d!d"d � y2|j<� j=d#|j>t?gt?d$�\}}|�s�|j>t@� W n* tk
�r� tjtd%� |j1d%gfS X tjj-|j"j,d&���r"tA|jddd'd(� n
tjd)� t |j� tB|t|�|j d*�}yR|}|}tjC|j| �\}}||k�sz||k�r�tjDd+||� tj|j| �\}}W n" tk
�r� tjtd,� Y nX tj |j� |jE� tF|j1|jd-� |j1tG|| | �fS ).Nz%s.dz91_kernel_cmdline_url.cfg)r3 ra z%s-local)�ds_deps�reporterzClosing stdin.z#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r% z0Failed to initialize, likely bad things to come!�trustz%s
ZcheckZmanual_cache_cleanFz"manual cache clean set from configZmanual_clean_markerz(manual cache clean found from marker: %s)�existingz)[%s] Exiting. datasource %s in local modezNo local datasource foundz8No instance datasource found! Likely bad things to come!)Zbring_upz [%s] Exiting without datasourcez No instance datasource found.z2[%s] barreling on in force mode without datasourcez5[%s] %s will now be targeting instance id: %s. new=%srv ra )�stage� retry_stagez.[%s] Exiting. datasource %s not in local mode.z6[%s] %s is in local mode, will apply init modules now.zinit-netzmodules:config� consume_data)r6 ZfreqzConsuming user data failed!Z userdata_rawT)�config�strictZ log_detailsZlog_deprecationsz2Skipping user-data validation. No user-data found.)ry z#Stdout, stderr changing to (%s, %s)z'Failed to re-adjust output redirection!)�
datasourcerA )Hr ZDEP_FILESYSTEMZ DEP_NETWORKrv rg r2 r3 rk r r( r
�Initry �read_cfgr7 r1 rS rT r � close_stdin� fixup_outputrA � Exception�logexcr) r$ rX r; � resetLogging� setupLoggingrB r+ r Z
initializerl rt Z DSMODE_LOCALZDSMODE_NETWORKr r! r" r Z
debug_inforu rq rV rp rw �fetchr� Zdsmode�DataSourceNotFoundException�forceZapply_network_config� _maybe_persist_instance_dataZ
instancifyZis_new_instance�_maybe_set_hostnameZsetup_datasource�update�cloudifyZrunr~ r r r r Zget_output_cfg�warningZactivate_datasource�di_report_warnr? )r5 r6 ZdepsZ
early_logs�w_msgrs ZoutfmtZerrfmtr% ZlvlZ path_helperrR r{ ZmcfgZmfileZbring_up_interfacesZiidZranZ_resultsr8 Z outfmt_origZ errfmt_origr& r& r' � main_init" s
r� c C s� d|krt jd� d S |d }|d kr4t jd� d S t|t�sNt jd|� d S |jd�}|d krnt jd� d S t|t�s�t jd|� d S | jjd�d }|j t
j �r�|t t
j �d � }nt jd
| |� ||kr�t jd | ||� d S t
jd ||t|�d
� d S )NZ di_reportz no di_report found in config.zdi_report was None.z%di_report config not a dictionary: %sZdatasource_listz(no 'datasource_list' found in di_report.z(di_report/datasource_list not a list: %s�.rN z1Datasource '%s' came from unexpected module '%s'.z:used datasource '%s' from '%s' was in di_report's list: %sZdsid_missing_source)�source�dslist)r) r; rZ �dictr� r@ �list�
__module__�
rpartitionrU r Z DS_PREFIXr: r Z show_warningr^ )r� rA Zdicfgr� �modnamer& r& r' r� sB
r� c C s. |j }td| |f �}tjg |jd�}|jt|�� y|jdd� W n> tj k
r� d| }t
j t |� t
|� |js~|gS Y nX t|� t|t|�|jd�}y$t jd� t
j� t
j|j|� W n tk
r� t
j t d� Y nX |j�r t jd � tj� tj|j� t|j� t||d
� t|||�S ) Nz%s:%s)rx ry rz )r{ zGCan not apply stage %s, no datasource found! Likely bad things to come!)ry z
Closing stdinz#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r% ) rR r( r
r� ry r� r7 r� r r� r r� r) r$ r� r� r r; r� r� rA r� rS r� r� rB r+ r? )r< r6 r5 r� rs r% r8 r& r& r' � main_modules3 s:
r� c
C s� |j }t| �}tjg |jd�}|jt|�� y|jdd� W n4 tj k
rp t
j t d� t
d� |jsldS Y nX t|� t|t|�|jd�}|j}|r�t jd|� |j}|r�t jd|� tj|�}y$t jd � t
j� t
j|jd � W n" tk
�r
t
j t d
� Y nX |j�r&t jd � tj� tj |j� t |j� t | |d � |j |||�\}} | �rpt j d
|� dS |�s�t j d|� dS dS d S )N)rx ry rz )r{ z;Failed to fetch your datasource, likely bad things to come!rP )ry z Using passed in arguments %sz Using passed in frequency %sz
Closing stdinz#Failed to setup output redirection!z@Logging being reset, this logger may no longer be active shortly)r% zRan %s but it failed!z Did not run %s, does it exist?r )!r5 r( r
r� ry r� r7 r� r r� r r� r) r$ r� r� r � module_argsr; Z frequency�FREQ_SHORT_NAMESr@ r� r� rA r� rS r� r� rB r+ Z
run_singler� )
r5 r6 Zmod_namer� rs r8 Zmod_argsZmod_freqr= r> r& r& r' � main_singlej sV
r� c C s |d krt � }|jd�}|d kr,tjjd�}tjj|d�}tjj|d�}tjj|d�}tjj|d�}tj||f� |j\} }
| dkr�|j r�d} q�d} n | dkr�d|j
} n t d | ��d } | | kr�t d
j | ���d }
| dk�r xL||||fD ]}tj
|� q�W n,ytjtj|��}
W n tk
�r* Y nX g d d d�}|
d k�rVdi i}
d |
d d< x,| D ]$}||
d k�r\|j� |
d |< �q\W |
d }| |d< tj� || d< tj||
� tjtjj||�|dd� yR|
| |�}| d k�r |\}}|d k �rt|�|d< n|}dd� |D �|| d< W nP tk
�rl } z2tjtd| � td| � t|�g|| d< W Y d d }~X nX tj� || d< d |d< tj||
� | d k�rg }x2| D ]*}|| d �r�|j || j dg �� �q�W tj|d|d |d�i� tjtjj||�|dd� t || d �S ) NrH z/run/cloud-initz status.jsonz result.jsonrs �
init-local�modulesz
modules-%szunknown name: %s� modules-init�modules-config�
modules-finalz'Invalid cloud init mode specified '{0}')�errors�start�finished�v1r� r| r� T)r� c S s g | ] }t |��qS r& )r^ )�.0rf r& r& r' �
<listcomp> s z"status_wrapper.<locals>.<listcomp>r� zfailed stage %szfailed run of stage %sr� )r� r� )rs r� r� r� r� )rs r� ) r rm r2 r3 �normpathrk r Z ensure_dirsr* rv rR �
ValueErrorr. Zdel_file�json�loadsZ load_filer� �copy�timer Z
write_jsonZsym_link�relpathr^ r� r) r$ �extendr@ r: )r5 r6 Zdata_dZlink_drl Z status_pathZ status_linkZ result_pathZ result_link�_name�functorrR Zmodes�status�fZ
nullstatusrb r� �retr� r� rf r& r& r' �status_wrapper� s�
$
r� )rs c C s6 | j r2| jr2| jjd�}tjj|�s2| j jdd� dS )zCWrite instance-data.json file if absent and datasource is restored.Z
instance_dataF)Z write_cacheN)r� Z ds_restoredrl Z get_runpathr2 r3 rV Zpersist_instance_data)rs Zinstance_data_filer& r& r' r� $ s r� c C sx | j � }tj| j|dd�\}}}|rtytjd| j|d� W n8 tjk
rr } ztjd||t |�� W Y dd}~X nX dS )z�Call set-hostname if metadata, vendordata or userdata provides it.
@param stage: String representing current stage in which we are running.
@param retry_stage: String represented logs upon error setting hostname.
T)Z
metadata_onlyz set-hostnameNzGFailed setting hostname in %s stage. Will retry in %s stage. Error: %s.)
r� r Zget_hostname_fqdnrA r ZhandleZSetHostnameErrorr) r; r^ )rs r| r} ZcloudZhostnameZ_fqdn�_rf r& r& r' r� , s r� c C s t jjdjttj��d � d S )Nr )r �stdoutr" rk �sortedr
ZFEATURES)r5 r6 r& r& r' �
main_featuresC s r� c " C sZ | s
t j} tj| jd�d�}|jddddtj� dd� |jd d
d d d
tjd�d� |jdddddd� |jdddddd� |j d d� |j
dd d �}d |_ |j d d d!�}|jd"d#dd$dd� |j d t
fd%� |j d&d'd!�}|jd(d)d*d+d,dcd.� |j d&tfd%� |j d/d0d!�}|jd1d2d*d3d d4� |jd5d*d6dttj� �d7� |jd8dd9dd4� |jd:d;d<d=d>� |j d/tfd%� |j d?d@d!�}|j dAdBd!�}|j dAtfd%� |j dCdDd!�}|j dEdFd!�} |j dGdHd!�}
|j dIdJd!�} |j dKdLd!�} |j dMdNd!�}
| �rH| d }|dCk�r$ddOlm} ||� �n$|dEk�rFddOlm} || � �n|dGk�rzddPlm}m} ||
� |
j dG|fd%� n�|dIk�r�ddQlm}m} || � | j dI|fd%� n�|d?k�r�ddRlm}m } ||� |j dS|fd%� nf|dMk�rddTl m}m } ||
� |
j dM|fd%� n2|dKk�rHddUl m}m } || � | j dK|fd%� |j!| dV�}|j"\} } |j#�rnt$j%� t&j'� | ddk�r�t(} d } d } | d k�r�|j)�r�de\} } ndf\} } nZ| d&k�r�d[|j* d\|j* } } n8| d/k�r�d]|j+ d^|j+ } } |j,} n| } d_| } d} t-j.| | | d`�|_/|j/�$ t0j1t2j#da| d | | |fdb�}!W d Q R X t3j4� |!S )gNr )�progz --versionz-vr
z %(prog)s z'Show program's version number and exit.)r* r
�helpz--filez-fr1 r0 z(Use additional yaml configuration files.�rb)r* �destr� �typez--debugz-d�
store_truez:Show additional pre-action logging (default: %(default)s).F)r* r� �defaultz--forcezDForce running even if no datasource is found (use at your own risk).r� )r* r� r� r� )ry Z Subcommands�
subcommand)�titler� Trs z2Initialize cloud-init and perform initial modules.)r� z--localz-lz+Start in local mode (default: %(default)s).)r* r� z1Activate modules using a given configuration key.z--modez-mZstorez8Module configuration name to use (default: %(default)s).r �final)r* r� r� �choicesZsinglezRun a single module.z--namez-nzModule name to run.)r* r� �requiredz --frequencyz Module frequency for this run.)r* r� r� r� z--reportzEnable reporting.r� �*Zargumentz0Any additional arguments to pass to this module.)�nargs�metavarr� Zqueryz;Query standardized instance metadata from the command line.ZfeatureszList defined features.Zanalyzez-Devel tool: Analyze cloud-init logs and data.ZdevelzRun development tools.z collect-logsz*Collect and tar all cloud-init debug info.Zcleanz3Remove logs and artifacts so cloud-init can re-run.r� z/Report cloud-init status or wait on completion.Zschemaz-Validate cloud-config files using jsonschema.)�
get_parser)r� �handle_collect_logs_args)r� �handle_clean_args)r� � handle_argsZrender)r� �handle_schema_args)r� �handle_status_args)r6 �
init-local� searching for local datasources� init-network�!searching for network datasourcesz
modules-%szrunning modules for %sz single/%szrunning single module %szrunning 'cloud-init %s')Zreporting_enabledzcloud-init mode '%s')Zlogfuncr% Z
get_uptime�funcr6 )rs r r� )r� rs )r� r� )r� r� )5r �argv�argparse�ArgumentParser�pop� add_argumentr
r/ ZFileTypeZ set_defaultsZadd_subparsersr� Z
add_parserr� r� r� r� �keysr� r� Zcloudinit.analyze.__main__r� Zcloudinit.cmd.devel.parserZcloudinit.cmd.devel.logsr� Zcloudinit.cmd.cleanr� Zcloudinit.cmd.queryr� �cloudinit.config.schemar� Zcloudinit.cmd.statusr� �
parse_argsr* r; rS ZsetupBasicLoggingr Zattach_handlersr� rv rR r5 Zreportr ZReportEventStackry r Zlog_timer) r Z flush_events)"Z sysv_args�parserZ
subparsersZ parser_initZ
parser_modZ
parser_singleZ parser_queryZparser_featuresZparser_analyzeZ parser_develZparser_collect_logsZ parser_cleanZ
parser_statusZ
parser_schemar� Zanalyze_parserZ devel_parserZ logs_parserr� Z clean_parserr� Z query_parserZhandle_query_argsZ
schema_parserr� Z
status_parserr� r6 r5 r� ZrnameZ report_onZrdescZretvalr& r& r' �mainG s:
r� �__main__ZTZz:/etc/localtime)r )N�rC rD )r� )TN)NN)N)Fr� r� r2 r r� r# Ztypingr Z cloudinitr Zcloudinit.config.modulesr Z
patch_loggingr� r r rS r r r r
r r r
r r Zcloudinit.reportingr Zcloudinit.settingsr r r r r Zcloudinit.configr Zcloudinit.cmd.develr r- r9 r� Z getLogger�__name__r) r$ r+ r( r7 r? rB rJ �intr^ rg rt rw r� r� r� r� r� r� r� r� r� r� �environr� Z return_value�exitr& r& r& r' �<module> st
l `27G
s
}