| Server IP : 209.38.156.173 / Your IP : 216.73.216.122 [ Web Server : Apache/2.4.52 (Ubuntu) System : Linux lakekumayuhotel 5.15.0-136-generic #147-Ubuntu SMP Sat Mar 15 15:53:30 UTC 2025 x86_64 User : root ( 0) PHP Version : 8.1.2-1ubuntu2.22 Disable Function : NONE Domains : 2 Domains MySQL : OFF | cURL : ON | WGET : ON | Perl : ON | Python : OFF | Sudo : ON | Pkexec : ON Directory : /usr/lib/python3/dist-packages/uaclient/__pycache__/ |
Upload File : |
o
F��c�P � @ s
d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlm Z d dl
m Z d dl m
Z
d dlmZmZmZmZmZmZmZ d dlmZmZ d dlmZ d dlm Z m Z m Z d d l m Z d d
l!m"Z" e#� Z$d Z%d Z&d
Z'dZ(dZ)e �*� Z+G dd� dej,�Z-G dd� dej.�Z/G dd� dej0�Z1e dd� �Z2dd� Z3 dVdee4ef d ee4ef d e4d ee4ef fd d �Z5d!e4d e6fd"d#�Z7dg fd$e4d%ee4 d e4fd&d'�Z8 (dWd$e4d)e6d*e6d e6fd+d,�Z9d-ee4 d.ee4 d dfd/d0�Z:di ddd1fd!e4d2ee; d3ee4e4f d4ee4 d5ee< d6e6d eeee
ee4e4f f f fd7d8�Z=d9ee4ef d:e4d e6fd;d<�Z>g d=�Z?e?fd>ee4 d e4fd?d@�Z@dAee" d e6fdBdC�ZAdDe4d e j fdEdF�ZBdGe4dHee4 dIe4d ee4 fdJdK�ZCdLe4d e4fdMdN�ZDdOdP� ZEdQdR� ZFdSee4 d ee4 fdTdU�ZGdS )X� N)�contextmanager��wraps)� HTTPMessage)�Any�Dict�List�Mapping�Optional�Tuple�Union)�error�request)�urlparse)� event_logger�
exceptions�messages)� CONFIG_FIELD_ENVVAR_ALLOWLIST)�MessagingOperations)z169.254.169.254�metadataz[fd00:ec2::254]zhttp://archive.ubuntu.comzhttps://esm.ubuntu.comzhttp://api.snapcraft.iozhttps://api.snapcraft.ioc @ s0 e Zd ZejdejdiZdejdefdd�Z dS )� LogFormatterzERROR: %(message)szDEBUG: %(message)s�record�returnc C s | j �|jd�}t�|��|�S )Nz %(message)s)�FORMATS�get�levelno�logging� Formatter�format)�selfr �log_fmt� r! �//usr/lib/python3/dist-packages/uaclient/util.pyr ' s zLogFormatter.formatN)
�__name__�
__module__� __qualname__r �ERROR�DEBUGr � LogRecord�strr r! r! r! r" r s
�r c s e Zd ZdZ� fdd�Z� ZS )�DatetimeAwareJSONEncoderzBA json.JSONEncoder subclass that writes out isoformat'd datetimes.c s t |tj�r
|�� S t� �|�S �N)�
isinstance�datetime� isoformat�super�default)r �o�� __class__r! r" r0 / s z DatetimeAwareJSONEncoder.default)r# r$ r% �__doc__r0 �
__classcell__r! r! r2 r" r* , s r* c s, e Zd ZdZ� fdd�Zedd� �Z� ZS )�DatetimeAwareJSONDecodera,
A JSONDecoder that parses some ISO datetime strings to datetime objects.
Important note: the "some" is because we seem to only be able extend
Python's json library in a way that lets us convert string values within
JSON objects (e.g. '{"lastModified": "2019-07-25T14:35:51"}'). Strings
outside of JSON objects (e.g. '"2019-07-25T14:35:51"') will not be passed
through our decoder.
(N.B. This will override any object_hook specified using arguments to it,
or used in load or loads calls that specify this as the cls.)
c s. d|v r |� d� t� j|d| ji|�� d S )N� object_hook)�popr/ �__init__r7 )r �args�kwargsr2 r! r" r9 C s
z!DatetimeAwareJSONDecoder.__init__c C sL | � � D ] \}}t|t�r#zt|�}W n ty |}Y nw || |< q| S r+ )�itemsr, r) �parse_rfc3339_date�
ValueError)r1 �key�value� new_valuer! r! r" r7 H s
� ��z$DatetimeAwareJSONDecoder.object_hook)r# r$ r% r4 r9 � staticmethodr7 r5 r! r! r2 r" r6 5 s
r6 c c s~ � dd� t �� jD �} | st �d� dV dS | d }|j}|t jkr(dV dS |�d� z dV W |�|� dS |�|� w )a�
A context manager that disables logging to console in its body
N.B. This _will not_ disable console logging if it finds the console
handler is configured at DEBUG level; the assumption is that this means we
want as much output as possible, even if it risks duplication.
This context manager will allow us to gradually move away from using the
logging framework for user-facing output, by applying it to parts of the
codebase piece-wise. (Once the conversion is complete, we should have no
further use for it and it can be removed.)
(Note that the @contextmanager decorator also allows this function to be
used as a decorator.)
c S s g | ] }|j d kr|�qS )z
ua-console)�name)�.0�handlerr! r! r" �
<listcomp>h s ��z*disable_log_to_console.<locals>.<listcomp>z0disable_log_to_console: no console handler foundNr i� )r � getLogger�handlers�debug�levelr' �setLevel)�potential_handlers�console_handler� old_levelr! r! r" �disable_log_to_consoleW s" ��
rO c s � �fdd�}|S )a� Decorator to retry on exception for retry_sleeps.
@param retry_sleeps: List of sleep lengths to apply between
retries. Specifying a list of [0.5, 1] tells subp to retry twice
on failure; sleeping half a second before the first retry and 1 second
before the second retry.
@param exception: The exception class to catch and retry for the provided
retry_sleeps. Any other exception types will not be caught by the
decorator.
c s t � ��� �fdd��}|S )Nc
sx �� � } z�| i |��W S � y: } z!|s|�dt|� }t�t|�| � t�|�d�� W Y d }~nd }~ww q)NTz Retrying %d more times.r )�copy�lenr rI r) �time�sleepr8 )r: r; �sleeps�e� retry_msg)� exception�f� retry_sleepsr! r" � decorator� s ���z)retry.<locals>.wrapper.<locals>.decoratorr )rX rZ �rW rY )rX r" �wrapper� s zretry.<locals>.wrapperr! )rW rY r\ r! r[ r" �retry� s r] � � orig_dict�new_dict�pathr c
C s� i }| � � D ]M\}}|�|t�}|s|n|d | }t|t�r8||v r3t||| |d�}|r2|||< qt||< q||krSd| d t|� d } t�t | �� |||< q|� � D ] \}}|| vrd|||< qX|S )z<Return a dictionary of delta between orig_dict and new_dict.�.)ra zContract value for 'z' changed to '�')
r< r � DROPPED_KEYr, �dict�get_dict_deltasr) r rI �redact_sensitive_logs)
r_ r` ra �deltasr? r@ rA �key_path� sub_delta�logr! r! r" rf � s@
��
�������rf �urlc C sR zt | �}W n
ty Y dS w |jdvrdS z|j W dS ty( Y dS w )NF)�https�httpT)r r> �scheme�port)rl �
parsed_urlr! r! r" �is_service_url� s �
��rr �msg�
valid_choicesc C sR d}d� |d�dd� |D ���} t�| � td��� }||v r# |S t�|� q)aG Interactive prompt message, returning a valid choice from msg.
Expects a structured msg which designates choices with square brackets []
around the characters which indicate a valid choice.
Uppercase and lowercase responses are allowed. Loop on invalid choices.
:return: Valid response character chosen.
r^ z{} is not one of: {}�, c S s g | ]}|� � �qS r! )�upper)rD �choicer! r! r" rF � s z"prompt_choices.<locals>.<listcomp>Tz> )r �join�event�info�input�lower)rs rt r@ � error_msgr! r! r" �prompt_choices� s
�
��r~ F�
assume_yesr0 c C s> |rdS | s t j} t| ��� �� }|dkr|S |dv r dS dS )a�
Display a confirmation prompt, returning a bool indicating the response
:param msg: String custom prompt text to emit from input call.
:param assume_yes: Boolean set True to skip confirmation input and return
True.
:param default: Boolean to return when user doesn't enter any text
This function will only prompt a single time, and defaults to "no" (i.e. it
returns False).
Tr^ )�y�yesF)r �
PROMPT_YES_NOr{ r| �strip)rs r r0 r@ r! r! r" �prompt_for_confirmation� s r� �
http_proxy� https_proxyc C s� i }| r| |d< |r||d< d� tt��}dD ]}tj�|�}|r2d� tt|�d���tt����}qt �
d|� |tjd< |tjd< |rVt � |�}t �
|�}t �|� dS dS ) a!
Configure urllib to use http and https proxies.
:param http_proxy: http proxy to be used by urllib. If None, it will
not be configured
:param https_proxy: https proxy to be used by urllib. If None, it will
not be configured
rn rm �,)�no_proxy�NO_PROXYzSetting no_proxy: %sr� r� N)rx �sorted�UA_NO_PROXY_URLS�os�environr �set�split�unionr rI r � ProxyHandler� build_opener�install_opener)r� r� �
proxy_dictr� �env_var� proxy_value�
proxy_handler�openerr! r! r" �configure_web_proxy s. ���
�r� T�data�headers�method�timeout�potentially_sensitivec sF |r|sd}t j| |� |d�}d�� fdd�t� �D ��}t�td�|p%d| ||r.|�d�nd ��� d }z t j ||d
��d }W n t
j yW } z
| �d }W Y d } ~ nd } ~ ww t �d ��
� �d�� �j}
d
t�j�dd��v rvt�|
�}
d��fdd�t�j�D ��}d�|p�d| ||
�} |r�t| �} t�| � |r���|
�jfS )N�POST)r� r� r� ru c s g | ]
}d � |� | ��qS �z
'{}': '{}')r �rD �k)r� r! r" rF 6 s zreadurl.<locals>.<listcomp>z'URL [{}]: {}, headers: {{{}}}, data: {}�GETzutf-8F)r� T�bodyzapplication/jsonz Content-typer^ c s g | ] }d � |� j| ��qS r� )r r� r� )�respr! r" rF N s z0URL [{}] response: {}, headers: {{{}}}, data: {})r �Requestrx r� r rI rg r �decode�urlopenr
� HTTPError�setattr�readr� r) r� r �json�loads) rl r� r� r� r� r� �req�sorted_header_str�http_error_foundrU �content� debug_msgr! )r� r� r" �readurl* sR ����
��
� �
r� �config�
path_to_valuec C s� | }i }|� d�}|d }|D ]}||krd}t|t�r#|�||�}q dS t|�}|�� dkr2dS |�� dkr:dS t�tj j
|d|d���) aK Check if value parameter can be translated into a boolean 'True' value.
@param config: A config dict representing
/etc/ubuntu-advantange/uaclient.conf
@param path_to_value: The path from where the value parameter was
extracted.
@return: A boolean value indicating if the value paramater corresponds
to a 'True' boolean value.
@raises exceptions.UserFacingError when the value provide by the
path_to_value parameter can not be translated into either
a 'False' or 'True' boolean value.
rb ����falseF�trueTz boolean string: true or false)r� �expected_valuer@ ) r� r, re r r) r| r �UserFacingErrorr �ERROR_INVALID_CONFIG_VALUEr )r� r� r@ �
default_value�paths�
leaf_valuer? � value_strr! r! r" �is_config_value_true\ s,
��r� )z(Bearer )[^\']+z(\'attach\', \')[^\']+z (\'machineToken\': \')[^\']+�(\'token\': \')[^\']+z((\'X-aws-ec2-metadata-token\': \')[^\']+z*(.*\[PUT\] response.*api/token,.*data: ).*z(https://bearer:)[^\@]+z1(/snap/bin/canonical-livepatch\s+enable\s+)[^\s]+z>(Contract\s+value\s+for\s+'resourceToken'\s+changed\s+to\s+).*z (\'resourceToken\': \')[^\']+z (\'contractToken\': \')[^\']+zF(https://contracts.canonical.com/v1/resources/livepatch\?token=)[^\s]+z (\"identityToken\": \")[^\"]+zT(response:\s+http://metadata/computeMetadata/v1/instance/service-accounts.*data: ).*r� z(\'userCode\': \')[^\']+z(\'magic_token=)[^\']+�
redact_regexsc C s | }|D ] }t �|d|�}q|S )z4Redact known sensitive information from log content.z\g<1><REDACTED>)�re�sub)rk r� � redacted_log� redact_regexr! r! r" rg � s rg �msg_opsc C sH | sdS | D ]}t |t�rt�|� q|\}}|di |��s! dS qdS )ah Emit messages to the console for user interaction
:param msg_op: A list of strings or tuples. Any string items are printed.
Any tuples will contain a callable and a dict of args to pass to the
callable. Callables are expected to return True on success and
False upon failure.
:return: True upon success, False on failure.
TFNr! )r, r) ry rz )r� �msg_op�functorr: r! r! r" �handle_message_operations� s
�r� �dt_strc C sD t �dd| �}t �dd|�}|�dd�}t �dd|�}tj�|d �S )
aT
Parse a datestring in rfc3339 format. Originally written for compatibility
with golang's time.MarshalJSON function. Also handles output of pythons
isoformat datetime method.
This drops subseconds.
:param dt_str: a date string in rfc3339 format
:return: datetime.datetime object of time represented by dt_str
z(\d{2}:\d{2}:\d{2})\.\d+z\g<1>z(\d{2}:\d{2}:\d{2})$z\g<1>Z�Zz+00:00z(-|\+)(\d{2}):(\d{2})$z\g<1>\g<2>\g<3>z%Y-%m-%dT%H:%M:%S%z)r� r� �replacer- �strptime)r� �dt_str_without_subseconds�
dt_str_with_z�dt_str_without_z�dt_str_with_pythonish_tzr! r! r" r= � s � � ��r= �protocol�proxy�test_urlc C s� |sd S t |�s
t�|��tj|dd�}t�| |i�}t�|�}z|�|� |W S tj t
j fyd } z,t � � t
|dt|��}t�
tjj|||d�� W d � n1 sVw Y t�|��d }~ww )N�HEAD)r� �reason)r� r� r
)rr r �ProxyInvalidUrlr r� r� r� �open�socketr� r
�URLErrorrO �getattrr) r r �ERROR_USING_PROXYr �ProxyNotWorkingError)r� r� r� r� r� r� rU rs r! r! r" �validate_proxy� s,
�� �
��r� �messagec C sP t jjdu sdt jj�� vr&| �dd�} | �tjd d�} | �tjd d�} | S )z}
Verify if the system can output unicode characters and if not,
remove those characters from the message string.
NzUTF-8u —�-� r^ )�sys�stdout�encodingrv r� r �
OKGREEN_CHECK�FAIL_X)r� r! r! r" �handle_unicode_characters s
�� r� c C s dd� t j�� D �S )Nc S s4 i | ]\}}|� � tv s|�d �s|dkr||�qS )� UA_FEATURES�UA_CONFIG_FILE)r| r �
startswith)rD r� �vr! r! r" �
<dictcomp>( s
����z'get_pro_environment.<locals>.<dictcomp>)r� r� r< r! r! r! r" �get_pro_environment' s �r� c C s� dd� }|� � D ]D\}}| �|�}t|t�r#t|t�r#t| | |� qt|t�rHt|t�rHt|�rBt|d t�rB|| | ||d� q || |< q|| |< qdS )a� Merge the contents of overlay dict into base_dict not only on top-level
keys, but on all on the depths of the overlay_dict object. For example,
using these values as entries for the function:
base_dict = {"a": 1, "b": {"c": 2, "d": 3}}
overlay_dict = {"b": {"c": 10}}
Should update base_dict into:
{"a": 1, "b": {"c": 10, "d": 3}}
@param base_dict: The dict to be updated
@param overlay_dict: The dict with information to be added into base_dict
c
S sv ddd�}g }|� |�}|D ]%}d}t| �D ]\}} | � |�|� |�kr+t| |� d}q|s3|�|� q| �|� d S )NrC �type)�availableResources�resourceEntitlementsFT)r � enumerate� depth_first_merge_overlay_dict�append�extend)
� base_values�overlay_valuesr? �merge_id_key_map�values_to_append�id_key�
overlay_value� was_replaced�base_value_idx�
base_valuer! r! r" �update_dict_listA s �
�
�z8depth_first_merge_overlay_dict.<locals>.update_dict_listr )r? N)r< r r, re r� �listrQ )� base_dict� overlay_dictr� r? r@ r� r! r! r" r� 1 s
�r� �archesc C sB t � }dddddd�}| D ]
}|�|�|�� |�� q
tt|��S )N�amd64�i386�ppc64el�arm64�armhf)�x86_64�i686�ppc64le�aarch64�armv7l)r� �addr r| r� r )r �deduplicated_arches� arch_aliases�archr! r! r" �deduplicate_archesd s � r )r^ )r^ FF)Hr- r� r r� r� r� r� rR �
contextlibr � functoolsr � http.clientr �typingr r r r r
r r �urllibr
r � urllib.parser �uaclientr r r �uaclient.defaultsr �uaclient.typesr �objectrd r� � PROXY_VALIDATION_APT_HTTP_URL� PROXY_VALIDATION_APT_HTTPS_URL� PROXY_VALIDATION_SNAP_HTTP_URL� PROXY_VALIDATION_SNAP_HTTPS_URL�get_event_loggerry r r � JSONEncoderr* � JSONDecoderr6 rO r] r) rf �boolrr r~ r� r� �bytes�intr� r� �REDACT_SENSITIVE_LOGSrg r� r= r� r� r� r� r r! r! r! r" �<module> s� $ "
) �
�
��
�! ����
���
�)���
����
� 2)��
�
�
�7���
�
3