FileNewTemplate
Artisto: production , Mail.ru Group
Artisto1- 1
3
4
1. , 1960 2. , 1974
3. ,1990-
5
Color image (RGB)
Feature maps3 channels
Convolutions
Inputoutput
6
:
-
pooling
edgesobject parts (combination of edges)object models
8
ImageNet Challenge
9
VGG-
10
11
+=
:
: A Neural Algorithm of Artistic Style
Texture Networks: Feed-forward Synthesis of Textures and
Stylized ImagesPerceptual Losses for Real-Time Style Transfer and
Super-Resolution
Prisma
VinciArtisto
Sept 201510 Mar 201627 Mar 201611 June 201628 Jul 201629 Jul
2016t
13
VGG- feature extractorxc
Feature maps
Feature maps
14
TargetoutputError back propagation
x L(x,c).
xx
: conv4_2
: , ..
conv1_1conv2_1conv3_1conv4_1conv5_1
: :
Feature maps
FWidthHeightDepth
Feature mapsFWidthHeightDepth
Width&Height
Mean vector
18
Error back propagation
Feature maps
Feature maps
: ,
conv1_1conv1_1conv2_1conv1_1conv2_1conv3_1conv4_1conv1_1conv2_1conv3_1conv4_1conv5_1
conv1_1conv2_1conv3_1
loss
scx
Error back propagation
, .
loss:
+ + + DL-: TensorFlow, Torch, Theano - CPU: 5minGPU: 10-15
secArtistic Style:
, .
Real-Time Style Transfer
-
sX
: .ConvolutionblockJoin block -
27
+ : - /Inference: 20-100 ms GPU- .: 1-4h (GPU, Titan X) - Torch
( )Real-Time Style Transfer:
28
29
30
Artistic style:
31
(, ) 100 /
: - .Artistic style:
32
ContentStyleExpected result+=Real-Time Style Transfer
33
StyleReal-Time Style Transfer:
- : Torch + Johnson+
Real-Time Style Transfer:
35
Real-Time Style Transfer:
36
37
:
38
:
Heatmap loss
, , .Designer loss
41
Zoom Designer loss
42
, //
+noise
Augmentation
43
Super-resolution .
+ , + waifu2x- : Super-resolution
44
Super-resolution: waifu
Heatmap lossDesigner lossAugmentationSuper-resolution :
48
- , , , Loss =>
49
,
FGLab
50
51
- GPURedbull/Monster???PROFIT
53
54
,
User experience
MSQRD/Snapchat + Artisto ICQ
57
!
?
Appendix
59
Torch (LUA) TensorFlow (Python) GPUBackendDocker- Ubuntu
centos7C + luajit GPU24ms, 350x35075ms, 1024x1024
60
Geforce Titan X 1080 amazon: , ( ) launch PC - GPU- : 4 x Titan
X
61
62
Johnson
