Skip to content

Commit 0cbce83

Browse files
committed
#92 Fix errors in new API
1 parent e7e55f8 commit 0cbce83

File tree

6 files changed

+191
-192
lines changed

6 files changed

+191
-192
lines changed

.gitignore

+2-1
Original file line numberDiff line numberDiff line change
@@ -146,4 +146,5 @@ sample_tweets.json
146146
.pypirc
147147

148148

149-
.DS_Store
149+
.DS_Store
150+
stweet_run.py

README.md

+15-5
Original file line numberDiff line numberDiff line change
@@ -40,10 +40,10 @@ pip install -U stweet
4040

4141
If you want to sponsor me, in thanks for the project, please send me some crypto 😁:
4242

43-
|Coin|Wallet address|
44-
|---|---|
45-
|Bitcoin|3EajE9DbLvEmBHLRzjDfG86LyZB4jzsZyg|
46-
|Etherum|0xE43d8C2c7a9af286bc2fc0568e2812151AF9b1FD|
43+
| Coin | Wallet address |
44+
|---------|--------------------------------------------|
45+
| Bitcoin | 3EajE9DbLvEmBHLRzjDfG86LyZB4jzsZyg |
46+
| Etherum | 0xE43d8C2c7a9af286bc2fc0568e2812151AF9b1FD |
4747

4848
## Basic usage
4949

@@ -104,15 +104,17 @@ Currently, stweet have implemented:
104104
- **PrintRawOutput** – prints all items (not recommended in large scrapping)
105105

106106
## Using tor proxy
107+
107108
Library is integrated with [tor-python-easy](https://github.com/markowanga/tor-python-easy).
108109
It allows using tor proxy with exposed control port – to change ip when it is needed.
109110

110111
If you want to use tor proxy client you need to prepare custom web client and use it in runner.
111112

112-
You need to run tor proxy -- you can run it on your local OS, or you can use this
113+
You need to run tor proxy -- you can run it on your local OS, or you can use this
113114
[docker-compose](https://github.com/markowanga/tor-python-easy/blob/main/docker-compose.yml).
114115

115116
Code snippet below show how to use proxy:
117+
116118
```python
117119
import stweet as st
118120

@@ -134,6 +136,14 @@ if __name__ == '__main__':
134136
web_client=web_client).run()
135137
```
136138

139+
## Divide scrap periods recommended
140+
141+
Twitter on guest client block multiple pagination. Sometimes in one query there is possible to call for 3 paginations.
142+
To avoid this limitation divide scrapping period for smaller parts.
143+
144+
Twitter in 2023 block in API putting time range in timestamp – only format YYYY-MM-DD is acceptable. In arrow you can
145+
only put time without hours.
146+
137147
## Twint inspiration
138148

139149
Small part of library uses code from [twint](https://github.com/twintproject/twint). Twint was also

0 commit comments

Comments
 (0)