Dima Gerasimov
1f61e853c9
reddit.rexport: experiment with using optional cpu pool (used by all of HPI)
...
Enabled by the env variable, specifying how many cores to dedicate, e.g.
HPI_CPU_POOL=4 hpi query ...
2023-10-25 02:06:45 +01:00
Dima Gerasimov
9ffce1b696
reddit.rexport: add accessors for subreddits, multireddits and profile
2023-10-19 02:26:28 +01:00
Dima Gerasimov
28d2450a21
reddit.rexport: some cleanup, move get_events stuff into personal overlay
2023-10-19 02:26:28 +01:00
Dima Gerasimov
dff31455f1
general: switch to make_logger in a few modules, use a bit more consistent logging, rely on default INFO level
2023-06-21 18:42:15 +01:00
Dima Gerasimov
c12224af74
misc: replace uses of pytz.utc with timezone.utc where it makes sense
2023-06-09 03:31:13 +01:00
Dima Gerasimov
c34656e8fb
general: update mypy config, seems that logs of type: ignore aren't necessary anymore
2023-05-16 01:18:30 +01:00
Kian-Meng Ang
d2ef23fcb4
docs: fix typos
...
found via `codespell -L copie,datas,pres,fo,tooks,noo,ue,ket,frop`
2023-03-27 03:02:35 +01:00
Dima Gerasimov
73e57b52d1
general: cleanup -- remove main and executable bit where it's not necessary
2022-05-31 22:16:05 +01:00
Sean Breckenridge
823668ca5c
make reddit.rexport logs info by default
...
can always be configured with HPI_LOGS
having this on debug makes hpi doctor
quite verbose
2022-02-02 00:35:54 +00:00
Dima Gerasimov
5e9cc2a6a0
my.reddit: enable CI tests
2021-12-24 18:02:37 +00:00
Sean Breckenridge
074b8685d6
reddit: pass logger to cachew
...
so that HPI_LOGS can be used to interact
with this module, to check if cachew
is working properly
2021-12-19 18:25:50 +00:00
Sean Breckenridge
d6c484f321
reddit: ensure rexport isnt pointing to repo
2021-10-31 21:47:10 +00:00
Sean Breckenridge
8422c6e420
my.reddit: refactor into module that supports pushshift/gdpr ( #179 )
...
* initial pushshift/rexport merge implementation, using id for merging
* smarter module deprecation warning using regex
* add `RedditBase` from promnesia
* `import_source` helper for gracefully handing mixin data sources
2021-10-31 20:39:04 +00:00
