-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathNotes.txt
157 lines (104 loc) · 1.74 KB
/
Notes.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
---------------------
- We will follow PEP-8 standards see the link for details
https://www.python.org/dev/peps/pep-0008/
- Databse is mongodb
using mongoalchemy : http://www.mongoalchemy.org/
- Stock API Quandl
https://www.quandl.com/api/v3/datasets/NSE/TCS.json?api_key=xMH7BiBu6s24LHCizug3
----------------------
2. Autofeeds + Varun can add feeds and category
1. Form to add things.
2. Feed + Cat
3. K Rank - Auto calcuate ( class)
6. Full Page Store
---
// feed_sources
https://alistapart.com/
{
id
url
rssLink
title
descripton
last_fetched
active: bool
Keywords
frequency
}
feed_sources_feed_catefory
{
feed_sources_id
feed_caterogy_id
}
feed_caterogy
{
id
name
slug
}
Raw
(
https://alistapart.com/article/web-maintainability-survey
item
{
id
title
feed_sources_id
item_link
text
author
full_text
last_fetched
published date
updated date
images XXX
tags
}
)
Processed
{
item
{
id
item_id
k_rank
}
}
we'll talk later
4. Sentiment Analysis ( class )
--
5. Keyword extraction
7. Summary
1. Cron Job
----
source env/bin/activate
pip install -r requirements.txt
pip install gunicorn
1. Cron Job
Feeds Only
1. Autofeeds
2. Varun can add feeds and category
3. K Rank - Auto calcuate
4. Sentiment Analysis
5. Keyword extraction
6. Full Page Store
7. Summary
30th
---
'pip install -r requirements.txt
sudo apt-get update && sudo apt-get install python-pip python-dev nginx git build-essential python2.7-dev
adduser kingkong
gpasswd -a kingkong sudo
su - kingkong
---
- Data Aggregation
- rss
- special sites (Later)
- twitter #tags
- facebook public
- Filter and Sorting
- Tags
- Reports (Later)
- Sentiment Analysis
- Link rank
- Summarize