@@ -40,10 +40,10 @@ pip install -U stweet
40
40
41
41
If you want to sponsor me, in thanks for the project, please send me some crypto 😁:
42
42
43
- | Coin| Wallet address|
44
- | ---| ---|
45
- | Bitcoin| 3EajE9DbLvEmBHLRzjDfG86LyZB4jzsZyg|
46
- | Etherum| 0xE43d8C2c7a9af286bc2fc0568e2812151AF9b1FD|
43
+ | Coin | Wallet address |
44
+ | --------- | ----------------------------------------- ---|
45
+ | Bitcoin | 3EajE9DbLvEmBHLRzjDfG86LyZB4jzsZyg |
46
+ | Etherum | 0xE43d8C2c7a9af286bc2fc0568e2812151AF9b1FD |
47
47
48
48
## Basic usage
49
49
@@ -104,15 +104,17 @@ Currently, stweet have implemented:
104
104
- ** PrintRawOutput** – prints all items (not recommended in large scrapping)
105
105
106
106
## Using tor proxy
107
+
107
108
Library is integrated with [ tor-python-easy] ( https://github.com/markowanga/tor-python-easy ) .
108
109
It allows using tor proxy with exposed control port – to change ip when it is needed.
109
110
110
111
If you want to use tor proxy client you need to prepare custom web client and use it in runner.
111
112
112
- You need to run tor proxy -- you can run it on your local OS, or you can use this
113
+ You need to run tor proxy -- you can run it on your local OS, or you can use this
113
114
[ docker-compose] ( https://github.com/markowanga/tor-python-easy/blob/main/docker-compose.yml ) .
114
115
115
116
Code snippet below show how to use proxy:
117
+
116
118
``` python
117
119
import stweet as st
118
120
@@ -134,6 +136,14 @@ if __name__ == '__main__':
134
136
web_client = web_client).run()
135
137
```
136
138
139
+ ## Divide scrap periods recommended
140
+
141
+ Twitter on guest client block multiple pagination. Sometimes in one query there is possible to call for 3 paginations.
142
+ To avoid this limitation divide scrapping period for smaller parts.
143
+
144
+ Twitter in 2023 block in API putting time range in timestamp – only format YYYY-MM-DD is acceptable. In arrow you can
145
+ only put time without hours.
146
+
137
147
## Twint inspiration
138
148
139
149
Small part of library uses code from [ twint] ( https://github.com/twintproject/twint ) . Twint was also
0 commit comments