U
|
©r_fw ã @ s d Z ddlZddlZddlZddlZddlZddlmZmZm Z e
|
dd ej d¡dd
D Z dZd Zed
|
ed ZejejfZd d Zdd Zdd Zdd Zdd Zdd Zdd Zdd Z d d Z d d Z d d! Z d"d# Z d$d% Z!dd'd(Z"d)d* Z#d+d, Z$d-d. Z%d/d0 Z&d1d2 Z'd3d4 Z(d5d6 Z)d7d8 Z*d9d: Z+d;d< Z,d=d> Z-d?d@ Z.dAdB Z/dCdD Z0dEdF Z1dGdH Z2dIdJ Z3dKdL Z4ddde)e/e0e1e2e3e4e*e+e*e+e*e+e*e+e,e,e-e-e.e.dMZ5e e e e e#e#e#e!e!e"e%e%e$e$e&e&e'e'eeee eedMZ6G dNdO dOZ7dPdQ Z8dRdS Z9dTdU Z:dVdW Z;ddYdZZ<G d[d\ d\Z=d]d^ Z>d_d`dadbdcdddedfdgdhdidjdkdldmgZ?d_d`dadbdndodedpdqdrdsdjdkdldmgZ@dtdududvdvdwdwdwdxdxdxdxdxdddyZAddzd{ZBdd}d~ZCG dd dZDdd ZEd_dpdqdrdsd`dbdndodjdkdldmg ZFdddZGG d
d dZHdd ZIdS )z9
|
@author: liaoxingyu
|
@contact: sherlockliao01@gmail.com
|
é N)ÚImageÚImageOpsÚ ImageEnhancec C s g | ] }t |qS © )Úint)Ú.0Úxr r ú ./data/transforms/autoaugment.pyÚ
|
<listcomp> s r
|
Ú.é )é r r g $@é9 )Útranslate_constÚimg_meanc C s. | dtj¡}t|ttfr&t |¡S |S d S )NÚresample)Úpopr ÚBILINEARÚ
|
isinstanceÚlistÚtupleÚrandomÚchoice)ÚkwargsÚ interpolationr r r Ú_interpolation- s
|
r c C s* d| krt dk r| d¡ t| | d< d S )NÚ fillcolor©é r r )Ú_PIL_VERr r )r r r r Ú_check_args_tf5 s
|
r c K s* t | | j| jtjd|ddddff|S ©Né r ©r Ú transformÚsizer ÚAFFINE©ÚimgÚfactorr r r r Úshear_x; s r* c K s* t | | j| jtjddd|ddff|S r! r# r' r r r Úshear_y@ s r+ c K s8 || j d }t| | j| j tjdd|dddff|S )Nr r" ©r% r r$ r r& ©r( Úpctr Úpixelsr r r Útranslate_x_relE s r0 c K s8 || j d }t| | j| j tjddddd|ff|S r! r, r- r r r Útranslate_y_relK s r1 c K s* t | | j| jtjdd|dddff|S r! r# ©r( r/ r r r r Útranslate_x_absQ s r3 c K s* t | | j| jtjddddd|ff|S r! r# r2 r r r Útranslate_y_absV s r4 c
|
K s$ t | tdkr | j|f|S tdkr| j\}}d}|d |d f}t |¡ }tt |¡dtt |¡ddtt |¡ dtt |¡ddg}dd } | |d |d |d
|
|d
|
|\|d < |d < |d |d 7 < |d |d
|
7 < | j | jt
|
j |f|S | j||d dS d S )N)r r r )r r g @é ç c S s8 |\}}}}}}|| || | || || | fS ©Nr ) r ÚyÚmatrixÚaÚbÚcÚdÚeÚfr r r r$ m s zrotate.<locals>.transformr r" r r r )r ) r r Úrotater% ÚmathÚradiansÚroundÚcosÚsinr$ r r& )
|
r( Údegreesr ÚwÚhÚ
|
post_transÚ rotn_centerÚangler9 r$ r r r r@ [ s2
|
|
ú ÿr@ c K s
|
t | ¡S r7 )r Ú autocontrast©r( Ú__r r r Ú auto_contrast{ s rO c K s
|
t | ¡S r7 )r ÚinvertrM r r r rP s rP c K s
|
t | ¡S r7 )r ÚequalizerM r r r rQ s rQ c K s t | |¡S r7 )r Úsolarize)r( ÚthreshrN r r r rR s rR r c K sx g }t dD ],}||k r.| td|| ¡ q | |¡ q | jdkrp| jdkrft|dkrf|| | }| |¡S | S d S )Né éÿ )ÚLÚRGBrW )ÚrangeÚappendÚminÚmodeÚlenÚpoint)r( ÚaddrS rN ÚlutÚir r r Ú solarize_add s
|
|
ra c K s |dkr | S t | |¡S )Né )r Ú posterize)r( Z bits_to_keeprN r r r rc s rc c K s t | ¡ |¡S r7 )r ÚContrastÚenhance©r( r) rN r r r Úcontrast s rg c K s t | ¡ |¡S r7 )r ÚColorre rf r r r Úcolor¤ s ri c K s t | ¡ |¡S r7 )r Ú
|
Brightnessre rf r r r Ú
|
brightness¨ s rk c K s t | ¡ |¡S r7 )r Ú Sharpnessre rf r r r Ú sharpness¬ s rm c C s t ¡ dkr| S | S )z With 50% prob, negate the valueç à?)r )Úvr r r Ú_randomly_negate° s rp c C s | t d } t| } | fS )Ng >@©Ú
|
_MAX_LEVELrp ©ÚlevelZ_hparamsr r r Ú_rotate_level_to_argµ s ru c C s | t d d fS )NgÍÌÌÌÌÌü?ç¹?)rr rs r r r Ú_enhance_level_to_arg¼ s rw c C s | t d } dt| } | fS )NgÍÌÌÌÌÌì?ç ð?rq rs r r r Ú _enhance_increasing_level_to_argÁ s ry c C s | t d } t| } | fS )Nç333333Ó?rq rs r r r Ú_shear_level_to_argÉ s r{ c C s& |d }| t t| } t| } | fS )Nr )rr Úfloatrp )rt Úhparamsr r r r Ú_translate_abs_level_to_argÐ s r~ c C s& | dd¡}| t | } t| } | fS )NÚ translate_pctgÍÌÌÌÌÌÜ?)Úgetrr rp )rt r} r r r r Ú_translate_rel_level_to_arg× s r c C s t | t d fS ©Né ©r rr rs r r r Ú_posterize_level_to_argß s r
c C s dt | |d fS )Nr r )r
)rt r} r r r Ú"_posterize_increasing_level_to_argæ s r c C s t | t d d fS r r rs r r r Ú _posterize_original_level_to_argí s r c C s t | t d fS )NrT r rs r r r Ú_solarize_level_to_argô s r c C s dt | |d fS )NrT r )r rs r r r Ú!_solarize_increasing_level_to_argú s r c C s t | t d fS )Nén r rs r r r Ú_solarize_add_level_to_arg s r )Ú AutoContrastÚEqualizeÚInvertÚRotateÚ PosterizeÚPosterizeIncreasingÚPosterizeOriginalÚSolarizeÚSolarizeIncreasingÚ SolarizeAddrh ÚColorIncreasingrd ÚContrastIncreasingrj ÚBrightnessIncreasingrl ÚSharpnessIncreasingÚShearXÚShearYZ
|
TranslateXZ
|
TranslateYÚ TranslateXRelÚ TranslateYRelc @ s e Zd ZdddZdd ZdS ) Ú AugmentOprn é
|
Nc C st |pt }t| | _t| | _|| _|| _| ¡ | _t d|krD|d nt
|
d|krV|d nt d| _ | j dd¡| _d S )Nr r )r r Ú magnitude_stdr )Ú_HPARAMS_DEFAULTÚ
|
NAME_TO_OPÚaug_fnÚ LEVEL_TO_ARGÚlevel_fnÚprobÚ magnitudeÚcopyr} ÚdictÚ_FILLÚ_RANDOM_INTERPOLATIONr r r )ÚselfÚnamer¦ r§ r} r r r Ú__init__? s
|
|
|
þ zAugmentOp.__init__c C s | j dk r t ¡ | j kr |S | j}| jr@| jdkr@t || j¡}tttd|}| jd k rh| || j ¡nt
|
}| j |f|| j S )Nrx r ) r¦ r r§ r ÚgaussrZ rr Úmaxr¥ r} r r£ r )r¬ r( r§ Z
|
level_argsr r r Ú__call__Q s zAugmentOp.__call__)rn r N©Ú__name__Ú
|
__module__Ú __qualname__r® r± r r r r r = s
|
r c s° ddgddgddgddgd d
|
gd d gd dgddgddgddgddgddgddgddgd d gd d gd d!gd"d#gd$d%gd&d'gd(d)gd*d+gd,d-gdd.gd/d0gg} fd1d2|D }|S )3N©r çé?r" ©r r· r ©rh çÙ?é ©r ç333333ã?é ©rh rº r" ©r r½ rb ©r r· r¾ ©r rº é ©r rº r ©r r½ r ©rh çÉ?r ©r r· rb ©r rº rb ©r r· r¾ ©r rÇ r» ©rh r½ r" ©r rx r ©r rº r» ©r r½ r ©r rx r» ©r r½ r¾ ©rh rº rà ©r r½ r )r rº é ©r rº rà ©r r½ rb ©rh r½ r» ©r rÇ r ©r r· r» ©r rx rà ©r r· r» ©r r6 r ©r r· r ©r r· r ©rh r½ r ©rh rx r ©r r½ r ©r r· r ©r r6 rb ©r rx r ©r r½ r ©r rº rà ©r r½ rà )r r· r ©r r½ r ©r r½ r" ©rh r· rÔ ©r rº r c s g | ]} fd d|D qS )c s g | ]}t |d iqS ©r} ©r ©r r: rì r r r
|
y s z5auto_augment_policy_v0.<locals>.<listcomp>.<listcomp>r ©r Úsprì r r r
|
y s z*auto_augment_policy_v0.<locals>.<listcomp>r ©r} ÚpolicyZpcr rì r Úauto_augment_policy_v0\ s8 çró c s° ddgddgddgddgd d
|
gd d gd dgddgddgddgddgddgddgddgd d gd d gd d!gd"d#gd$d%gd&d'gd(d)gd*d+gd,d-gdd.gd/d0gg} fd1d2|D }|S )3Nr¶ r¸ r¹ r¼ r¿ rÀ rÁ r rÄ rÅ rÆ rÈ rÉ rÊ rË rÌ rÍ rÎ rÏ rÐ rÑ rÒ rÓ ©r rº rÔ rÕ rÖ r× rØ rÙ rÚ rÛ rÜ rÝ rÞ rß rà rá râ rã rä rå ræ rç )r r· r rè ré rê rë c s g | ]} fd d|D qS )c s g | ]}t |d iqS rì rí rî rì r r r
|
s z6auto_augment_policy_v0r.<locals>.<listcomp>.<listcomp>r rï rì r r r
|
s z+auto_augment_policy_v0r.<locals>.<listcomp>r rñ r rì r Úauto_augment_policy_v0r} s8 çrõ c s° ddgddgddgddgd d
|
gd d gd dgddgddgddgd dgddgddgddgdd gd d gd d gd d!gd"d#gddgd d
|
gddgddgdd gddgg} fd$d%|D }|S )&N)r rº rb ©r r½ r» ©r r½ r ©r r½ r rÈ r¼ )r r½ rà )r r½ rÔ r rØ ©r rº r ©r r· rb ©r r½ r¾ ©r r½ rà )r r· r rÍ ©r rÇ r¾ rÖ ©r r½ rb )r rº rÔ ©rh rº r ©r rº r» ©r r½ r ©r r6 rà ©r r½ r ©r rx rb rß ©rd rx rb ©rh rx r ©rh r· rb ©r r· rà ©rl rº rà ©r r½ rb ©r r½ r rÐ c s g | ]} fd d|D qS )c s g | ]}t |d iqS rì rí rî rì r r r
|
¼ s z;auto_augment_policy_original.<locals>.<listcomp>.<listcomp>r rï rì r r r
|
¼ s z0auto_augment_policy_original.<locals>.<listcomp>r rñ r rì r Ú auto_augment_policy_original s8 çr c s° ddgddgddgddgd d
|
gd d gd dgddgddgddgd dgddgddgddgdd gd d gd d gd d!gd"d#gddgd d
|
gddgddgdd gddgg} fd$d%|D }|S )&N)r rº rb rö r÷ rø rÈ r¼ )r r½ rà )r r½ rÔ r rØ rù rú rû rü )r r· r rÍ rý rÖ rþ rô rÿ r r r r r rß r r r r r r
|
r rÐ c s g | ]} fd d|D qS )c s g | ]}t |d iqS rì rí rî rì r r r
|
Ý s z<auto_augment_policy_originalr.<locals>.<listcomp>.<listcomp>r rï rì r r r
|
Ý s z1auto_augment_policy_originalr.<locals>.<listcomp>r rñ r rì r Ú auto_augment_policy_originalrÀ s8 çr Úoriginalc C sX t }| dkrt|S | dkr$t|S | dkr4t|S | dkrDt|S dsTtd| d S )Nr Z originalrZv0Zv0rFzUnknown AA policy (%s))r¡ r r ró rõ ÚAssertionError)r r} r r r Úauto_augment_policyá s r c @ s e Zd Zdd Zdd ZdS )Ú AutoAugmentc C s || _ d| _t | _d S )Nr )Ú
|
total_iterÚgammar rò )r¬ r r r r r® ñ s zAutoAugment.__init__c C sT t dd¡| jkrLt | j¡}td| jd| j | _|D ] }||}q:|S |S d S )Nr r" rx )r Úuniformr r rò rZ r )r¬ r( Z
|
sub_policyÚopr r r r± ö s
|
zAutoAugment.__call__Nr² r r r r r ï s r c C s | d¡}|d }|dd
}|D ]T}t d|¡}t|dk r@q"|dd
\}}|dkrj| dt|¡ q"d s"td
|
q"t|}t|S ) a[
|
Create a AutoAugment transform
|
:param config_str: String defining configuration of auto augmentation. Consists of multiple sections separated by
|
dashes ('-'). The first section defines the AutoAugment policy (one of 'v0', 'v0r', 'original', 'originalr').
|
The remaining sections, not order sepecific determine
|
'mstd' - float std deviation of magnitude noise applied
|
Ex 'original-mstd0.5' results in AutoAugment with original policy, magnitude_std 0.5
|
:param hparams: Other hparams (kwargs) for the AutoAugmentation scheme
|
:return: A PyTorch compatible Transform
|
ú-r r" Nú(\d.*)r Úmstdr Fz"Unknown AutoAugment config section)ÚsplitÚrer\ Ú
|
setdefaultr| r r r ) Ú
|
config_strr} ÚconfigZ policy_namer< ÚcsÚkeyÚvalZ aa_policyr r r Úauto_augment_transform s
|
r! r r r r r r r rh rd rj rl r r r r r r r r r r rz rÇ rv g?g{®Gázt?)r r r r r rh rl r r r rd rj r r r c s< |pt }| dkstt fdd|D }|t |¡ }|S )Nr c s g | ] } | qS r r )r Úk©Z rand_weightsr r r
|
\ s z(_select_rand_weights.<locals>.<listcomp>)Ú_RAND_TRANSFORMSr Ú_RAND_CHOICE_WEIGHTS_0ÚnpÚsum)Ú
|
weight_idxÚ
|
transformsÚprobsr r# r Ú_select_rand_weightsX s r+ r c s$ pt |pt} fdd|D S )Nc s g | ]}t |d dqS )rn ©r¦ r§ r} rí ©r r ©r} r§ r r r
|
d s ÿ ÿz$rand_augment_ops.<locals>.<listcomp>)r¡ r$ ©r§ r} r) r r. r Úrand_augment_opsa s
|
ÿr0 c @ s e Zd ZdddZdd ZdS )Ú RandAugmentr Nc C s || _ || _|| _d S r7 )ÚopsÚ
|
num_layersÚchoice_weights)r¬ r2 r3 r4 r r r r® i s zRandAugment.__init__c C s6 t jj| j| j| jd k| jd}|D ] }||}q$|S )N)ÚreplaceÚp)r& r r r2 r3 r4 )r¬ r( r2 r r r r r± n s ÿ
|
zRandAugment.__call__)r Nr² r r r r r1 h s
|
r1 c C s t }d}d}t}| d¡}|d dks*t|dd
}|D ] }t d|¡}t|dk rXq:|dd
\} }
|
| dkr| d t|
|
¡ q:| d
|
krt|
|
rÚt }q:| d krªt
|
|
|
}q:| d kr¼t
|
|
|
}q:| d krÎt
|
|
|
}q:ds:tdq:t |||d} |dkrödnt |} t | || dS )a
|
Create a RandAugment transform
|
:param config_str: String defining configuration of random augmentation. Consists of multiple sections separated by
|
dashes ('-'). The first section defines the specific variant of rand augment (currently only 'rand'). The remaining
|
sections, not order sepecific determine
|
'm' - integer magnitude of rand augment
|
'n' - integer num layers (number of transform ops selected per image)
|
'w' - integer probabiliy weight index (index of a set of weights to influence choice of op)
|
'mstd' - float std deviation of magnitude noise applied
|
'inc' - integer (bool), use augmentations that increase in severity with magnitude (default: 0)
|
Ex 'rand-m9-n3-mstd0.5' results in RandAugment with magnitude 9, num_layers 3, magnitude_std 0.5
|
'rand-mstd1-w0' results in magnitude_std 1.0, weights 0, default magnitude of 10 and num_layers 2
|
:param hparams: Other hparams (kwargs) for the RandAugmentation scheme
|
:return: A PyTorch compatible Transform
|
r Nr r Úrandr" r r r ÚincÚmÚnrG Fz"Unknown RandAugment config sectionr/ )r4 )rr r$ r r r r\ r r| ÚboolÚ_RAND_INCREASING_TRANSFORMSr r0 r+ r1 ) r r} r§ r3 r( r) r r< r r r Zra_opsr4 r r r Úrand_augment_transformw s6
|
|
|
|
r= c s$ pt |pt} fdd|D S )Nc s g | ]}t |d dqS )rx r, rí r- r. r r r
|
º s ÿ ÿz augmix_ops.<locals>.<listcomp>)r¡ Ú_AUGMIX_TRANSFORMSr/ r r. r Ú
|
augmix_ops· s
|
ÿr? c @ s: e Zd ZdZdddZdd Zd
|
d Zd d Zdd ZdS )Ú AugMixAugmenta AugMix Transform
|
Adapted and improved from impl here: https://github.com/google-research/augmix/blob/master/imagenet.py
|
From paper: 'AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty -
|
https://arxiv.org/abs/1912.02781
|
rx r¾ éÿÿÿÿFc C s" || _ || _|| _|| _|| _d S r7 )r2 ÚalphaÚwidthÚdepthÚblended)r¬ r2 rB rC rD rE r r r r® Å s
|
zAugMixAugment.__init__c C s\ || }d}g }|d d d
D ]"}|| }|d| 9 }| |¡ q tj|d d d
tjdS )Nrx rA r" ©Údtype)rY r& ÚarrayÚfloat32)r¬ Úwsr9 ZcumpZrwsrG rB r r r Ú_calc_blended_weightsÌ s z#AugMixAugment._calc_blended_weightsc C sx | ¡ }| ||¡}|D ]Z}| jdkr,| jn tj dd¡}tjj| j|dd}|} |D ] }
|
|
|
| } qVt || |¡}q|S )Nr r" r T©r5 )
|
r¨ rK rD r& r Úrandintr r2 r Úblend) r¬ r( Úmixing_weightsr9 Zimg_origrJ rG rD r2 Úimg_augr r r r Ú_apply_blendedÖ s
|
z AugMixAugment._apply_blendedc C sÊ |j d |j d t| ¡ f}tj|tjd}|D ]d}| jdkrF| jn tj dd¡}tjj | j
|
|dd}|} |D ] }
|
|
|
| } qp||tj | tjd 7 }q2tj |dd|d t | tj¡¡}t |||¡S ) Nr r" rF r TrL g ào@)Úout)r% r\ Úgetbandsr& ÚzerosrI rD r rM r r2 ÚasarrayÚclipr Ú fromarrayÚastypeÚuint8rN ) r¬ r( rO r9 Ú img_shapeÚmixedZmwrD r2 rP r r r r Ú _apply_basicæ s
|
zAugMixAugment._apply_basicc C s\ t t j | jg| j ¡¡}t t j | j| j¡¡}| jrJ| |||¡}n| |||¡}|S r7 )
|
r& rI r Ú dirichletrB rC ÚbetarE rQ r\ )r¬ r( rO r9 r[ r r r r± ÷ s zAugMixAugment.__call__N)rx r¾ rA F) r³ r´ rµ Ú__doc__r® rK rQ r\ r± r r r r r@ ¾ s
|
|
r@ c C s d}d}d}d}d}| d¡}|d dks.t|dd
}|D ]®}t d
|
|¡} t| d k r\q>| d d
\}
|
} |
|
d kr| d t| ¡ q>|
|
dkrt| }q>|
|
dkrªt| }q>|
|
dkr¼t| }q>|
|
dkrÎt| }q>|
|
dkràt| }q>ds>tdq>t||d} t | ||||dS )aµ Create AugMix PyTorch transform
|
:param config_str: String defining configuration of random augmentation. Consists of multiple sections separated by
|
dashes ('-'). The first section defines the specific variant of rand augment (currently only 'rand'). The remaining
|
sections, not order sepecific determine
|
'm' - integer magnitude (severity) of augmentation mix (default: 3)
|
'w' - integer width of augmentation chain (default: 3)
|
'd' - integer depth of augmentation chain (-1 is random [1, 3], default: -1)
|
'b' - integer (bool), blend each branch of chain into end result without a final blend, less CPU (default: 0)
|
'mstd' - float std deviation of magnitude noise applied (default: 0)
|
Ex 'augmix-m5-w4-d2' results in AugMix with severity 5, chain width 4, chain depth 2
|
:param hparams: Other hparams (kwargs) for the Augmentation transforms
|
:return: A PyTorch compatible Transform
|
r¾ rA rx Fr r Zaugmixr" Nr r r r r9 rG r= r: r; z Unknown AugMix config section)r§ r} )rB rC rD rE )
|
r r r r\ r r| r r; r? r@ ) r r} r§ rC rD rB rE r r< r r r r2 r r r Úaugment_and_mix_transform s8
|
|
|
|
|
|
r` )r )r )r N)r NN)r NN)Jr_ rA r r ÚPILÚnumpyr& r r r r Ú __version__r r rª rr r© r¡ r ÚBICUBICr« r r r* r+ r0 r1 r3 r4 r@ rO rP rQ rR ra rc rg ri rk rm rp ru rw ry r{ r~ r r
r r r r r r¤ r¢ r ró rõ r r r r r! r$ r< r% r+ r0 r1 r= r> r? r@ r` r r r r Ú<module> sZ "þ
|
ç è !"!!
|
ñññ
|
|
0ó
|
C
|
