-
Notifications
You must be signed in to change notification settings - Fork 0
/
overview.html
159 lines (143 loc) · 5.85 KB
/
overview.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
<!DOCTYPE html>
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta charset="utf-8" />
<title><no title> - Scanner</title>
<link rel="stylesheet" href="_static/basic.css" type="text/css" />
<link rel="stylesheet" href="_static/pygments.css" type="text/css" />
<link rel="stylesheet" type="text/css" href="_static/custom.css" />
<script id="documentation_options" data-url_root="./" src="_static/documentation_options.js"></script>
<script src="_static/jquery.js"></script>
<script src="_static/underscore.js"></script>
<script src="_static/doctools.js"></script>
<script src="_static/language_data.js"></script>
<link rel="index" title="Index" href="genindex.html" />
<link rel="search" title="Search" href="search.html" />
<meta charset='utf-8'>
<meta http-equiv='X-UA-Compatible' content='IE=edge,chrome=1'>
<meta name='viewport' content='width=device-width, initial-scale=1.0, maximum-scale=1'>
<meta name="apple-mobile-web-app-capable" content="yes">
<link rel="stylesheet" href="https://stackpath.bootstrapcdn.com/bootstrap/4.3.1/css/bootstrap.min.css" />
<link rel="stylesheet"
href="//cdnjs.cloudflare.com/ajax/libs/highlight.js/9.15.6/styles/default.min.css">
<!-- Global site tag (gtag.js) - Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=UA-133298183-1"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-133298183-1');
</script>
</head><body>
<div class="related" role="navigation" aria-label="related navigation">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
accesskey="I">index</a></li>
<li class="right" >
<a href="py-modindex.html" title="Python Module Index"
>modules</a> |</li>
<li class="nav-item nav-item-0"><a href="index.html">Scanner 0.2.22 documentation</a> »</li>
</ul>
</div>
<div class="container">
<div id="navbar" class="navbar-default">
<div class="row">
<div class="col-md-4 col-sm-12">
<a class="navbar-brand" href="index.html"><span><img src="_static/scanner_logo.png"></span>
</a>
</div>
<div class="col-md-4 offset-md-4 col-sm-12">
<div class="btn-group">
<a href="guide.html"><button type="button" class="btn btn-light">Guide</button></a>
<a href="api.html"><button type="button" class="btn btn-light">API</button></a>
<a href="https://github.com/scanner-research/scanner"><button type="button" class="btn btn-light">Github</button></a>
<a href="publications.html"><button type="button" class="btn btn-light">Publications</button></a>
</div>
</div>
</div>
</div>
<div class="row">
<div class="col-md-12">
<div class="content">
<div class="row">
<div class="col-xs-12 text-center banner">
<h1>
Overview
</h1>
<h2>
An aerial view of the major concepts in Scanner and how they work together to make Scanner applications efficient and scalable.
</h2>
</div>
</div>
<div class="row">
<div class="col-xs-12">
<div class="col-xs-8 col-xs-offset-2">
<h3>
Videos as Streams
</h3>
<p>
Videos are first-class citizens in Scanner and are represented as streams of frames, even if the video is stored in a compressed format like h.264. Scanner supports arbitrary sparse gather operations from these streams so your application only needs to read (and possibly decode) exeactly the frames it needs.
</p>
</div>
</div>
</div>
<div class="row">
<div class="col-xs-12">
<div class="col-xs-8 col-xs-offset-2">
<h3>
Video processing as Streams and Ops
</h3>
<p>
Applications are expressed in Scanner as <i> dataflow </i> graphs. Dataflow graphs are composed of <b>streams</b>, which may be videos or other sequences of data, and <b>ops</b>, stateful functions which process elements from streams.
</p>
</div>
</div>
</div>
<div class="row">
<div class="col-xs-12">
<div class="col-xs-8 col-xs-offset-2">
<h3>
Parallelizing within a single machine
</h3>
<p>
Given a dataflow graph, Scanner manages all the details of executing your application on machines with both CPUs and GPUs. This includes reading the data efficiently from local or networked storage, decoding video frames if necessary, scheduling ops to both CPUs and GPUs, handling data movement between ops, and writing data out to an external storage system.
</p>
</div>
</div>
</div>
<div class="row">
<div class="col-xs-12">
<div class="col-xs-8 col-xs-offset-2">
<h3>
Scaling to hundreds of machines in the cloud
</h3>
<p>
Scanner's dataflow graphs are designed to be split up and distributed across machines.
</p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="related" role="navigation" aria-label="related navigation">
<h3>Navigation</h3>
<ul>
<li class="right" style="margin-right: 10px">
<a href="genindex.html" title="General Index"
>index</a></li>
<li class="right" >
<a href="py-modindex.html" title="Python Module Index"
>modules</a> |</li>
<li class="nav-item nav-item-0"><a href="index.html">Scanner 0.2.22 documentation</a> »</li>
</ul>
</div>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.3.1/js/bootstrap.min.js"></script>
<script src="//cdnjs.cloudflare.com/ajax/libs/highlight.js/9.15.6/highlight.min.js"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/9.15.6/languages/python.min.js"></script>
<script>hljs.initHighlightingOnLoad();</script>
</body>
</html>