�
z fc @ s& d Z d d l Z d d l Z d d d d d d d d
g Z d d d
d d d d d d d d d d d d d d g Z d d d
d d d d d d d d d d d d d d d d d d d d! g Z d d" d d d d d d d d# d$ d d d d% g Z d
d" d& d' d d d d d# d$ g
Z d d d d d d d
d d d# d$ d g Z d d" d d
d' d d d d d d d d g
Z d( Z
d) Z d* d+ d, g Z d- Z
i Z d. � Z d/ e f d0 � � YZ d d1 l m Z d2 e d2 d3 � e f d4 � � YZ d5 e d5 d6 � e f d7 � � YZ d e d8 � Z d9 � Z d: d; � Z d< � Z d= � Z d e d> � Z d? � Z d@ � Z e dA � Z dB � Z y e! Wn e" k
r�dC � Z# n
XdD � Z# dE Z$ e% dF � e$ D� � Z& e j' dG � Z( dH � Z) d: d: d d dI � Z+ dJ e, f dK � � YZ- dL Z. d a/ d: d: d d dM � Z0 d S(N s3 Parse (absolute and relative) URLs.
urlparse module is based upon the following RFC specifications.
RFC 3986 (STD66): "Uniform Resource Identifiers" by T. Berners-Lee, R. Fielding
and L. Masinter, January 2005.
RFC 2732 : "Format for Literal IPv6 Addresses in URL's by R.Hinden, B.Carpenter
and L.Masinter, December 1999.
RFC 2396: "Uniform Resource Identifiers (URI)": Generic Syntax by T.
Berners-Lee, R. Fielding, and L. Masinter, August 1998.
RFC 2368: "The mailto URL scheme", by P.Hoffman , L Masinter, J. Zwinski, July 1998.
RFC 1808: "Relative Uniform Resource Locators", by R. Fielding, UC Irvine, June
1995.
RFC 1738: "Uniform Resource Locators (URL)" by T. Berners-Lee, L. Masinter, M.
McCahill, December 1994
RFC 3986 is considered the current standard and any future changes to
urlparse module should conform with it. The urlparse module is
currently not entirely compliant with this RFC due to defacto
scenarios for parsing, and for backward compatibility purposes, some
parsing quirks from older RFCs are retained. The testcases in
test_urlparse.py provides a good indicator of parsing behavior.
The WHATWG URL Parser spec should also be considered. We are not compliant with
it either due to existing user code API behavior expectations (Hyrum's Law).
It serves as a useful guide when making changes.
i����Nt urlparset
urlunparset urljoint urldefragt urlsplitt
urlunsplitt parse_qst parse_qslt ftpt httpt gophert nntpt imapt waist filet httpst shttpt mmst prosperot rtspt rtsput t sftpt svns svn+ssht telnett snewst rsynct nfst gits git+ssht hdlt sipt sipst telt mailtot newssA abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ0123456789+-.s!
s s
s
i c C s t j � d S( s Clear the parse cache.N( t _parse_cachet clear( ( ( s /usr/lib64/python2.7/urlparse.pyt clear_cacheP s t ResultMixinc B sJ e Z d Z e d � � Z e d � � Z e d � � Z e d � � Z RS( s- Shared methods for the parsed result objects.c C sX | j } d | k rT | j d d � d } d | k rP | j d d � d } n | Sd S( Nt @i i t :( t netloct rsplitt splitt None( t selfR) t userinfo( ( s /usr/lib64/python2.7/urlparse.pyt usernameX s c C sR | j } d | k rN | j d d � d } d | k rN | j d d � d Sn d S( NR' i i R( ( R) R* R+ R, ( R- R) R. ( ( s /usr/lib64/python2.7/urlparse.pyt passwordb s c C s� | j j d � d } d | k rI d | k rI | j d � d d j � Sd | k rl | j d � d j � S| d k r| d S| j � Sd S( NR' i����t [t ]i i R( R ( R) R+ t lowerR, ( R- R) ( ( s /usr/lib64/python2.7/urlparse.pyt hostnamek s c C s� | j j d � d j d � d } d | k r} | j d � d } | r} t | d � } d | k on d k n rz | Sq} n d S( NR' i����R2 R( i i
i i�� ( R) R+ t intR, ( R- R) t port( ( s /usr/lib64/python2.7/urlparse.pyR6 w s #
( t __name__t
__module__t __doc__t propertyR/ R0 R4 R6 ( ( ( s /usr/lib64/python2.7/urlparse.pyR& U s
( t
namedtuplet SplitResults! scheme netloc path query fragmentc B s e Z d Z d � Z RS( c C s
t | � S( N( R ( R- ( ( s /usr/lib64/python2.7/urlparse.pyt geturl� s ( ( R7 R8 t __slots__R= ( ( ( s /usr/lib64/python2.7/urlparse.pyR< � s t ParseResults( scheme netloc path params query fragmentc B s e Z d Z d � Z RS( c C s
t | � S( N( R ( R- ( ( s /usr/lib64/python2.7/urlparse.pyR= � s ( ( R7 R8 R> R= ( ( ( s /usr/lib64/python2.7/urlparse.pyR? � s c C ss t | | | � } | \ } } } } } | t k rT d | k rT t | � \ } } n d } t | | | | | | � S( s# Parse a URL into 6 components:
<scheme>://<netloc>/<path>;<params>?<query>#<fragment>
Return a 6-tuple: (scheme, netloc, path, params, query, fragment).
Note that we don't break the components up in smaller bits
(e.g. netloc is a single string) and we don't expand % escapes.t ;R ( R t uses_paramst _splitparamsR? ( t urlt schemet allow_fragmentst tupleR) t queryt fragmentt params( ( s /usr/lib64/python2.7/urlparse.pyR � s c C se d | k r@ | j d | j d � � } | d k rO | d f Sn | j d � } | | | | d f S( Nt /R@ i R i ( t findt rfind( RC t i( ( s /usr/lib64/python2.7/urlparse.pyRB � s
i c C sb t | � } x> d D]6 } | j | | � } | d k r t | | � } q q W| | | !| | f S( Ns /?#i ( t lenRK t min( RC t startt delimt ct wdelim( ( s /usr/lib64/python2.7/urlparse.pyt _splitnetloc� s
c C s� | s t | t � r d Sd d l } | j d d � } | j d d � } | j d d � } | j d d � } | j d | � } | | k r� d Sx- d D]% } | | k r� t d | � � q� q� Wd S(
Ni����u @u u :u #u ?t NFKCs /?#@:s> netloc %r contains invalid characters under NFKC normalization( t
isinstancet unicodet unicodedatat replacet normalizet
ValueError( R) RX t nt netloc2RR ( ( s /usr/lib64/python2.7/urlparse.pyt _checknetloc� s
c C s' x t D] } | j | d � } q W| S( NR ( t _UNSAFE_URL_BYTES_TO_REMOVERY ( RC t b( ( s /usr/lib64/python2.7/urlparse.pyt _remove_unsafe_bytes_from_url� s
c C s5 t | � } t | � } | j t � } | j t � } t | � } | | | t | � t | � f } t j | d � } | r | St t � t
k r� t � n d } } } | j d � } | d k rJ| | d k r�| | j
� } | | d } | d d k rYt | d � \ } } d | k r/d | k sGd | k rYd | k rYt d
� � qYn | r�d | k r�| j d d � \ } } n d | k r�| j d d � \ } } n t | � t | | | | | � } | t | <| Sxj | | D] }
|
t k r�Pq�q�W| | d } | s-t d
� | D� � rJ| | j
� | } } qJn | d d k r�t | d � \ } } d | k r�d | k s�d | k r�d | k r�t d
� � q�n | r�d | k r�| j d d � \ } } n d | k r| j d d � \ } } n t | � t | | | | | � } | t | <| S( s Parse a URL into 5 components:
<scheme>://<netloc>/<path>?<query>#<fragment>
Return a 5-tuple: (scheme, netloc, path, query, fragment).
Note that we don't break the components up in smaller bits
(e.g. netloc is a single string) and we don't expand % escapes.R R( i R i i s //R1 R2 s Invalid IPv6 URLt #t ?c s s | ] } | d k Vq d S( t
0123456789N( ( t .0RR ( ( s /usr/lib64/python2.7/urlparse.pys <genexpr>� s N( Ra t lstript _WHATWG_C0_CONTROL_OR_SPACEt stript boolt typeR# t getR, RN t MAX_CACHE_SIZER% RK R3 RT R[ R+ R^ R< t scheme_charst any( RC RD RE t keyt cachedR) RG RH RM t vRR t rest( ( s /usr/lib64/python2.7/urlparse.pyR � sb !
c C sJ | \ } } } } } } | r1 d | | f } n t | | | | | f � S( s� Put a parsed URL back together again. This may result in a
slightly different, but equivalent URL, if the URL that was parsed
originally had redundant delimiters, e.g. a ? with an empty query
(the draft states that these are equivalent).s %s;%s( R ( t dataRD R) RC RI RG RH ( ( s /usr/lib64/python2.7/urlparse.pyR s c C s� | \ } } } } } | s= | rw | t k rw | d d k rw | r` | d d k r` d | } n d | pl d | } n | r� | d | } n | r� | d | } n | r� | d | } n | S( sk Combine the elements of a tuple as returned by urlsplit() into a
complete URL as a string. The data argument can be any five-item iterable.
This may result in a slightly different, but equivalent URL, if the URL that
was parsed originally had unnecessary delimiters (for example, a ? with an
empty query; the RFC states that these are equivalent).i s //i RJ R R( Rc Rb ( t uses_netloc( Rs RD R) RC RG RH ( ( s /usr/lib64/python2.7/urlparse.pyR s (
c C sh | s
| S| s | St | d | � \ } } } } } } t | | | � \ } }
} } }
} | | k st | t k rx | S| t k r� |
r� t | |
| | |
| f � S| }
n | d d k r� t | |
| | |
| f � S| r | r | } | } |
s| }
n t | |
| | |
| f � S| j d � d | j d � } | d d k r]d | d <n x d | k r|| j d � q`Wxr d } t | � d } xU | | k r�| | d k r�| | d d k r�| | d | d 5Pn | d } q�WPq�W| d d g k rd | d <n2 t | � d k rC| d d k rCd g | d )n t | |
d j | � | |
| f � S(
sa Join a base URL and a possibly relative URL to form an absolute
interpretation of the latter.R i RJ i����t .s ..i i����( R s ..( R t
uses_relativeRt R R+ t removeRN t join( t baseRC RE t bschemet bnetloct bpatht bparamst bqueryt bfragmentRD R) t pathRI RG RH t segmentsRM R\ ( ( s /usr/lib64/python2.7/urlparse.pyR % sX $$
"c C s` d | k rR t | � \ } } } } } } t | | | | | d f � } | | f S| d f Sd S( s� Removes any existing fragment from URL.
Returns a tuple of the defragmented URL and the fragment. If
the URL contained no fragments, the second element is the
empty string.
Rb R N( R R ( RC t sR\ t pt at qt fragt defrag( ( s /usr/lib64/python2.7/urlparse.pyR Y s
c C s d S( Ni ( ( t x( ( s /usr/lib64/python2.7/urlparse.pyt _is_unicodej s c C s
t | t � S( N( RV RW ( R� ( ( s /usr/lib64/python2.7/urlparse.pyR� m s t 0123456789ABCDEFabcdefc c s? | ]5 } t D]( } | | t t | | d � � f Vq
q d S( i N( t _hexdigt chrR5 ( Re R� R` ( ( s /usr/lib64/python2.7/urlparse.pys <genexpr>v s s ([ -]+)c C sO t | � r� d | k r | St j | � } | d g } | j } xU t d t | � d � D]; } | t t | | � � j d � � | | | d � qZ Wd j | � S| j d � } t | � d k r� | S| d g } | j } x^ | d D]R } y$ | t
| d � | | d � Wq� t k
r=| d � | | � q� Xq� Wd j | � S( s" unquote('abc%20def') -> 'abc def'.t %i i i t latin1R ( R� t _asciireR+ t appendt rangeRN t unquotet strt decodeRx t _hextochrt KeyError( R� t bitst resR� RM t item( ( s /usr/lib64/python2.7/urlparse.pyR� z s.
#
c C s` i } xS t | | | | | � D]9 \ } } | | k rK | | j | � q | g | | <q W| S( s2 Parse a query given as a string argument.
Arguments:
qs: percent-encoded query string to be parsed
keep_blank_values: flag indicating whether blank values in
percent-encoded queries should be treated as blank strings.
A true value indicates that blanks should be retained as
blank strings. The default false value indicates that
blank values are to be ignored and treated as if they were
not included.
strict_parsing: flag indicating what to do with parsing errors.
If false (the default), errors are silently ignored.
If true, errors raise a ValueError exception.
max_num_fields: int. If set, then throws a ValueError if there
are more than n fields read by parse_qsl().
( R R� ( t qst keep_blank_valuest strict_parsingt max_num_fieldst separatort dictt namet value( ( s /usr/lib64/python2.7/urlparse.pyR � s t _QueryStringSeparatorWarningc B s e Z d Z RS( s> Warning for using default `separator` in parse_qs or parse_qsl( R7 R8 R9 ( ( ( s /usr/lib64/python2.7/urlparse.pyR� � s s /etc/python/urllib.cfgc C sp | s t | t t f � r8 | d k r8 t d � � n t � } | d k r�t } d } | d k r� t j j | � } d } n | d k ry t
t � } Wn t k
r� qX| �B d d l
} | j
� }
|
j | � |
j d | � } | a Wd QXt } n | d k rbd | k rYd d l m } | d d
d d d
d d t d d �n d } q�| d k rw| } q�t | � d k r�t d j | | � d d � � q�n | d k r| | k r�d | j d � | j d � } n d | j | � } | | k rt d � � qn | | k rbg | j d � D]" }
|
j d � D] } | ^ qJq7} n" g | j | � D] }
|
^ qr} g } x� | D]� } | r�| r�q�n | j d d � } t | � d k r| r�t d | f � n | r�| j d � qq�n t | d � s| r�t | d j d d � � } t | d j d d � � } | j | | f � q�q�W| S( s Parse a query given as a string argument.
Arguments:
qs: percent-encoded query string to be parsed
keep_blank_values: flag indicating whether blank values in
percent-encoded queries should be treated as blank strings. A
true value indicates that blanks should be retained as blank
strings. The default false value indicates that blank values
are to be ignored and treated as if they were not included.
strict_parsing: flag indicating what to do with parsing errors. If
false (the default), errors are silently ignored. If true,
errors raise a ValueError exception.
max_num_fields: int. If set, then throws a ValueError if there
are more than n fields read by parse_qsl().
Returns a list, as G-d intended.
s* Separator must be of type string or bytes.t PYTHON_URLLIB_QS_SEPARATORs environment variablei����NR R@ ( t warns0 The default separator of urlparse.parse_qsl and s1 parse_qs was changed to '&' to avoid a web cache s" poisoning issue (CVE-2021-23336). s4 By default, semicolons no longer act as query field s separators. s3 See https://access.redhat.com/articles/5860431 for s
more details.t
stackleveli t &t legacyi s {} (from {}) must contain s 1 character, or "legacy". See s< https://access.redhat.com/articles/5860431 for more details.s Max number of fields exceededt =s bad query field: %rR i t +t ( RV R� t bytesR, R[ t objectt _default_qs_separatort ost environRk t opent _QS_SEPARATOR_CONFIG_FILENAMEt EnvironmentErrort ConfigParsert readfpt warningsR� R� RN t formatt countR+ R� R� RY ( R� R� R� R� R� t _legacyt envvar_namet
config_sourceR R� t configR� t
num_fieldst s1t s2t pairst rt
name_valuet nvR� R� ( ( s /usr/lib64/python2.7/urlparse.pyR � st )
# # ;"
(1 R9 t reR� t __all__Rv Rt RA t non_hierarchicalt
uses_queryt
uses_fragmentRm Rg R_ Rl R# R% R� R& t collectionsR; R< R? t TrueR RB RT R^ Ra R R R R R RW t NameErrorR� R� R� R� t compileR� R� R, R t RuntimeWarningR� R� R� R ( ( ( s /usr/lib64/python2.7/urlparse.pyt <module>! sv ."" =
4