Dima Gerasimov
1cc4eb5d8d
core: add helper for computing stats; use it in modules
2020-06-04 22:19:34 +01:00
Dima Gerasimov
3d7844b711
core: support '' for explicitly set empty path set
2020-06-01 23:45:26 +01:00
Dima Gerasimov
ca39187c63
github: DEPRECATE my.coding.github
...
Instead my.github.all should be used (still backward compatible)
The reasons are
a) I don't feel that grouping (i.e. my.coding.*) makes much sense
b) using .all pattern (same way as twitter) allows for more composable and cleaner separation of GDPR and API data
2020-06-01 22:49:31 +01:00
Dima Gerasimov
d7aff1be3f
github: start moving to a proper artbitrated module
2020-06-01 22:49:31 +01:00
Dima Gerasimov
7bd7cc9228
cli: integrate with stats reported by the modules
2020-05-25 11:46:30 +01:00
Dima Gerasimov
248e48dc30
core: improve types for warn_if_empty
...
ok, works with this advice https://github.com/python/mypy/issues/1927 + overloads
2020-05-25 01:23:30 +01:00
Dima Gerasimov
616ffb457e
core: user overloads to type @warn_if_empty properly..
2020-05-25 00:25:33 +01:00
Dima Gerasimov
e3a71ea6c6
my.core: more work on typing @warn_if_empty, extra test
2020-05-25 00:25:33 +01:00
Dima Gerasimov
4b22d17188
core: add @warn_if_empty decorator
2020-05-25 00:25:33 +01:00
Dima Gerasimov
b99b2f3cfa
core: add warning when get_files returns no files, my.twitter.archive: make more defensive in case of no archives
2020-05-24 12:51:23 +01:00
Dima Gerasimov
03773a7b2c
twitter module: prettify top level twitter.all
2020-05-22 19:00:02 +01:00
Dima Gerasimov
c8bdbfd69f
core: expand '~' in get_files & import_dir
2020-05-18 22:43:27 +01:00
Dima Gerasimov
0f80e9d5e6
ok, seems that import_dir is a bit saner
2020-05-18 21:04:38 +01:00
Dima Gerasimov
44aa062756
tests: thinking about external repositories
2020-05-18 20:42:10 +01:00
Dima Gerasimov
c0bbb4eaf2
misc: get rid of SimpleNamespace uses
2020-05-17 22:05:23 +01:00
Dima Gerasimov
2a9fd54c12
Improve documentation for some modules
2020-05-17 21:56:58 +01:00
Dima Gerasimov
3d8002c8c9
polar: support configuring defensive behaviour, support for highlight tags
2020-05-15 12:40:15 +01:00
Dima Gerasimov
759b0e1324
polar: expose a proper filename
2020-05-15 10:11:09 +01:00
Dima Gerasimov
87ad9d38bb
polar: add test for orger integration
2020-05-15 09:52:18 +01:00
Dima Gerasimov
0f27071dcc
polar: minor improvements, konsume: more type annotations
2020-05-15 09:07:23 +01:00
Dima Gerasimov
f3d5064ff2
polar: allow properly specifying polar_dir, with ~ as a default
2020-05-15 08:18:47 +01:00
Dima Gerasimov
b2b7eee480
polar: add test against custom public repos
2020-05-15 07:42:21 +01:00
Dima Gerasimov
92cf375480
move rss stuff in a separate subpackage
2020-05-13 22:58:09 +01:00
Dima Gerasimov
eba2d26b31
Update lastfm order/tests/docs
2020-05-13 22:52:23 +01:00
Dima Gerasimov
522bfff679
update configuration doc & more tests
2020-05-13 22:52:23 +01:00
Dima Gerasimov
1d0ef82d32
Add test demonstrating unloading the module during dynamic configuration
2020-05-10 21:57:55 +01:00
Dima Gerasimov
0ac78143f2
add my.demo for testing out various approaches to configuring
2020-05-10 21:32:48 +01:00
Dima Gerasimov
c877104b90
another attempt to make the configs more self-documenting: via NamedTuple
2020-05-09 23:17:44 +01:00
Dima Gerasimov
66453cb29b
add @classproperty, change set_repo to not require the parent
2020-05-09 20:03:35 +01:00
Dima Gerasimov
6ecb953675
cleanup, mypy coverage & add common/error stubs
2020-05-06 22:54:14 +01:00
Dima Gerasimov
069732600c
cleanup for reddit data provider
2020-05-06 08:09:20 +01:00
Dima Gerasimov
6d1fba2171
Extra test for MY_CONFIG variable; fix order import for stub/dynamic config
2020-05-05 22:22:32 +01:00
Dima Gerasimov
636060db57
Simplify config discovery: get rid of the hacky stub and reimport proper config automatically
2020-05-05 22:22:32 +01:00
Dima Gerasimov
fd224d8c38
add test for config.set_repo
2020-05-04 22:08:58 +01:00
Dima Gerasimov
4cceccd787
add test for dynamic config attributes (import my.cfg as config)
2020-05-04 22:08:58 +01:00
Dima Gerasimov
1f07e1a2a8
enable mypy on CI for core stuff
2020-05-04 19:52:18 +01:00
Dima Gerasimov
3912ef2460
fix zstd handling and github wrapper
2020-05-04 19:52:18 +01:00
Dima Gerasimov
55ac85c7e7
cpath tests, rely more on it
2020-05-04 08:53:41 +01:00
Dima Gerasimov
8b8a85e8c3
kompress.kopen improvements
...
- tests
- uniform handling for bytes/str, always return utf8 str by default
2020-05-04 08:37:36 +01:00
Dima Gerasimov
c3a77b6256
initial kompress tests
2020-05-04 07:50:29 +01:00
Dima Gerasimov
db47ba2d7e
Move get_files tests to separate file
2020-05-04 07:17:20 +01:00
Dima Gerasimov
0b61dd9e42
more minor tweaks, benefit from get_files
2020-05-03 17:15:51 +01:00
Dima Gerasimov
5706f690e7
support implicit globs!
2020-05-03 16:52:09 +01:00
Dima Gerasimov
c2961cb1cf
properly test get_files
2020-05-03 16:30:57 +01:00
Dima Gerasimov
5c6eec62ee
start testing get_files
2020-05-03 16:17:48 +01:00
Dima Gerasimov
cd3f2996a3
port tests for takeout from kython
2020-04-26 16:50:06 +01:00
Dima Gerasimov
a84b51807f
more takeout to a separate subpackage
2020-04-24 18:10:33 +01:00
Dima Gerasimov
d1aa4d19dc
get rid of callbacks in takeout processing interface
2020-04-24 17:34:56 +01:00
Dima Gerasimov
810fe21839
attempt to use xmllint to speed up takeout parsing
2020-04-24 16:35:20 +01:00
Dima Gerasimov
adadffef16
add takeout parser test
2020-04-24 16:11:19 +01:00