fz0x1/HPI
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
802 commits 3 branches 41 tags 2.5 MiB
Commit graph

44 commits

Author SHA1 Message Date
Sean Breckenridge
8422c6e420
my.reddit: refactor into module that supports pushshift/gdpr (#179) 
* initial pushshift/rexport merge implementation, using id for merging
* smarter module deprecation warning using regex
* add `RedditBase` from promnesia
* `import_source` helper for gracefully handing mixin data sources
 2021-10-31 20:39:04 +00:00
Sean Breckenridge
5ecd4b4810 cleanup; remove unused imports 2021-04-02 08:38:06 +01:00
Dima Gerasimov
ced93e6942 reflect cachew changes of exception handling and temporary suppression 2020-10-08 21:22:02 +02:00
Dima Gerasimov
1c20eb27aa CI: add mypy checks for my.reddit, my.pocket and my.github.ghexport 2020-09-30 23:33:06 +02:00
Dima Gerasimov
0682919449 general: use module dependencies as proper PIP packages + fallback 2020-09-30 23:33:06 +02:00
Dima Gerasimov
abbaa47aaf core.warnings: handle stacklevel properly 
add more warnings about deprecated config arguments
 2020-09-29 19:44:45 +02:00
Dima Gerasimov
109edd9da3 general: add compat module and helper for easy backwards compatibiltity for pre-PIP dependencies 
my.hypothesis: use hypexport as a proper PIP package + fallback
 2020-09-29 19:44:45 +02:00
Dima Gerasimov
4ee89b85ee reddit: add stats() 2020-07-30 22:37:21 +01:00
Dima Gerasimov
092aef88ce core: detect compression, wrap in CPath if necessary 2020-07-26 21:31:26 +01:00
Dima Gerasimov
77deef98de reddit: more consistent handling for events 2020-07-26 21:31:26 +01:00
Dima Gerasimov
031b1278eb reddit: cleanup cachew wrapper a bit 2020-07-26 21:31:26 +01:00
Dima Gerasimov
02ba71a91d documentation: generate tables of content, better navigation 2020-05-18 23:31:55 +01:00
Dima Gerasimov
403ec18385 core/modules: get rid of set_repo uses, it was just complicating everythin 2020-05-18 21:33:52 +01:00
Dima Gerasimov
2a9fd54c12 Improve documentation for some modules 2020-05-17 21:56:58 +01:00
Dima Gerasimov
976b3da6f4 Autoextract documentation for some modules, improve docs 2020-05-10 18:09:12 +01:00
Dima Gerasimov
9cb39103c6 start autogenerating documentation on modules 2020-05-10 16:42:40 +01:00
Dima Gerasimov
8cbbafae1d extract dataclass-based config helper 2020-05-10 15:18:45 +01:00
Dima Gerasimov
217116dfe9 Use @dataclass with reddit, seems to work well 2020-05-10 14:47:02 +01:00
Dima Gerasimov
c877104b90 another attempt to make the configs more self-documenting: via NamedTuple 2020-05-09 23:17:44 +01:00
Dima Gerasimov
4b8c2d4be4 Inherit from the base config 2020-05-09 22:21:15 +01:00
Dima Gerasimov
90b9d1d9c1 Use Protocol for proper config documentation 2020-05-09 21:38:25 +01:00
Dima Gerasimov
c75747f371 improving config documentation and allowing for fallbacks 2020-05-09 20:06:07 +01:00
Dima Gerasimov
069732600c cleanup for reddit data provider 2020-05-06 08:09:20 +01:00
Dima Gerasimov
c3a77b6256 initial kompress tests 2020-05-04 07:50:29 +01:00
Dima Gerasimov
9bd61940b8 rely on implicit glob for my.reddit 2020-05-03 16:56:05 +01:00
Dima Gerasimov
19e90eb647 improvements to @mcachew type checking 2020-05-03 15:57:11 +01:00
Dima Gerasimov
51ae8601b4 Update docstrings and add links 2020-04-26 16:50:06 +01:00
Dima Gerasimov
1273b0ca61 update docstrings 2020-04-13 23:48:58 +01:00
Dima Gerasimov
e5b3a1e91e use my.config instead of mycfg; minor cleanups and docstrings 2020-04-12 00:22:10 +01:00
Dima Gerasimov
09a0c8eb28 handle more fixmes, add make_dict 2020-03-24 21:15:21 +01:00
Dima Gerasimov
d00e09d1a1 More module descriptions 2020-02-26 16:32:03 +01:00
Dima Gerasimov
e3b3b12ff1 add more stuff to kompress; less kython deps 2020-02-01 15:17:13 +00:00
Dima Gerasimov
12330dd604 cachew demo for reddit 2020-01-26 22:36:24 +00:00
Dima Gerasimov
7d56d85731 enhance reddit module 2020-01-17 19:00:26 +00:00
Dima Gerasimov
34bd2356ae update paths to data access layers 2020-01-10 23:37:21 +00:00
Dima Gerasimov
5611fce720 Use defensive cachew 2020-01-07 00:12:49 +00:00
Dima Gerasimov
066641a4ce Rename my_configuration to mycfg for brevity 2019-12-19 20:14:26 +00:00
Dima Gerasimov
77c8328714 Fix remaining mypy issues in reddit provider 2019-12-08 17:34:00 +00:00
Dima Gerasimov
3d82e542fe refactor reddit events interface, use cachew 2019-12-08 11:47:35 +00:00
Dima Gerasimov
a6d16b9c55 adapt twitter provider for public consumption 2019-11-07 20:59:57 +00:00
Dima Gerasimov
a0b9d2dc05 Use user's polar dir 2019-10-11 22:10:12 +01:00
Dima Gerasimov
a4e1deb458 fix mypy, use more links to models 2019-10-08 21:18:53 +01:00
Dima Gerasimov
bf8ceea523 disable parallel for reddit 2019-09-29 17:37:43 +01:00
Dima Gerasimov
5295759949 Import private reddit data provider, use rexport model 2019-09-29 16:42:04 +01:00
Renamed from reddit/__init__.py (Browse further)