karlicoss
71cb66df5f
core: add helper for more_iterable to check that all types involved are hashable
...
Otherwise unique_everseen performance may degrade to quadratic rather than linear
For now hidden behind HPI_CHECK_UNIQUE_EVERSEEN flag
also switch some modules to use it
2023-10-31 01:02:17 +00:00
karlicoss
f28f68b14b
general: enhancle logging for various modules
2023-10-29 22:32:07 +00:00
Dima Gerasimov
f355a55e06
my.instagram.gdpr: process all historic archives + better normalising
2023-10-23 18:42:50 +01:00
Dima Gerasimov
f9a1050ceb
my.instagram.android: more defensive error handling
2023-10-23 18:42:50 +01:00
karlicoss
8c2d1c9463
general: use less explicit kompress boilerplate in modules
...
now get_files/kompress library can handle it transparently
2023-10-20 21:13:59 +01:00
Dima Gerasimov
c283e542e3
general: fix some issues after mypy update
2023-08-24 23:46:23 +01:00
Dima Gerasimov
d6af4dec11
my.instagram.android: minor cleanup + cachew
2023-06-21 20:42:10 +01:00
Dima Gerasimov
dff31455f1
general: switch to make_logger in a few modules, use a bit more consistent logging, rely on default INFO level
2023-06-21 18:42:15 +01:00
Dima Gerasimov
fe88380499
general: switch to using native 3.8 versions for cached_property/Literal/Protocol instead of compat
2023-05-16 01:18:30 +01:00
Kian-Meng Ang
d2ef23fcb4
docs: fix typos
...
found via `codespell -L copie,datas,pres,fo,tooks,noo,ue,ket,frop`
2023-03-27 03:02:35 +01:00
Dima Gerasimov
919c84fb5a
my.instagram: better unification of like messages/reactions
2023-03-27 02:16:17 +01:00
Dima Gerasimov
9aadbb504b
my.instagram.android: properly extract our own user
2023-03-27 02:16:17 +01:00
Dima Gerasimov
8f7d14e7c6
my.instagram: somewhat mad merging mechanism to correlate gdpr and android exports
2023-03-27 02:16:17 +01:00
Dima Gerasimov
e7be680841
my.instagram.gdpr: handle missing message content defensively
2023-03-27 02:16:17 +01:00
Dima Gerasimov
9c432027b5
instagram.android: fix missing id
2023-02-07 01:57:00 +00:00
Dima Gerasimov
c8cf0272f9
instagram.gdpr: use new path to personal information
2022-10-19 00:06:23 +01:00
Dima Gerasimov
b9d788efd0
some enhancements for facebook/instagram modules
...
figured out that datetimes are naive
better username handling + investigation of thread names
2022-06-04 17:16:28 +01:00
Dima Gerasimov
b5f266c2bd
my.instagram: add initial all.py + some experiments on nicer errors
2022-06-03 23:49:27 +01:00
Dima Gerasimov
bf3dd6e931
core/sqlite: experiment at typing SELECT query (to some extent)
...
ideally would be cool to use TypedDict here somehow, but perhaps it'd only be possible after variadic generics https://peps.python.org/pep-0646
2022-06-03 23:49:27 +01:00
Dima Gerasimov
7a1b7b1554
core/general: add assert_never + typing annotations for dataset
2022-06-03 23:49:27 +01:00
Dima Gerasimov
706ec03a3f
instagram.gdpr: use ZipPath instead of adhoc zipfile methods
...
this allows using the module more agnostic whether the gpdr archive is packed or unpacked
2022-04-15 12:36:11 +01:00
Dima Gerasimov
1e635502a2
instagram: initial module for GDPR export
...
still somewhat WIP, unclear how to correlate it with android data
2022-02-04 00:18:33 +00:00
Dima Gerasimov
e30953195c
instagram: initial module for android app data (direct messages)
2022-02-02 21:50:43 +00:00
