fz0x1/HPI
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
1153 commits 3 branches 41 tags 2.5 MiB
Commit graph

1153 commits

This branch
This branch
All branches
Author SHA1 Message Date
purarue
f1d23c5e96 smscalls: allow large XML files as input 
once XML files increase past a certain size
(was about 220MB for me), the parser just throws
an error because the tree is too large (iirc for
security reasons)

could maybe look at using iterparse in the future
to parse it without loading the whole file, but this
seems to fix it fine for me
 2024-12-28 21:46:28 +00:00
purarue
d8c53bde34 smscalls: add phone number to model 2024-11-26 21:53:52 +00:00
purarue
95a16b956f
doc: some performance notes for query_range (#409) 
* doc: some performance notes for query_range
* add ruff_cache to gitignore
 2024-11-26 21:53:10 +00:00
purarue
a7f05c2cad doc: spelling fixes 2024-11-26 21:51:40 +00:00
Srajan Garg
ad55c5c345
fix typo in rexport DAL (#405) 
* fix typo in rexport DAL
 2024-11-13 00:05:27 +00:00
purarue
7ab6f0d5cb chore: update urls 2024-10-30 20:12:00 +00:00
Dima Gerasimov
a2b397ec4a my.whatsapp.android: adapt to new db format 2024-10-22 21:35:52 +01:00
Dima Gerasimov
8496d131e7 general: migrate modules to use 3.9 features 2024-10-19 23:41:22 +01:00
karlicoss
d3f9a8e8b6
core: migrate code to benefit from 3.9 stuff (#401) 
for now keeping ruff on 3.8 target version, need to sort out modules as well
 2024-10-19 20:55:09 +01:00
Dima Gerasimov
bc7c3ac253 general: python3.9 reached EOL, switch min version 
also enable 3.13 on CI
 2024-10-19 18:58:17 +01:00
Dima Gerasimov
a8f86e32b9 core.time: hotfix for default force_abbreviations attribute 2024-09-23 22:04:41 +01:00
Dima Gerasimov
6a6d157040 cli: fix minor race condition in creating hpi_temp_dir 2024-09-23 01:22:16 +01:00
Dima Gerasimov
bf8af6c598 tox: try using uv for CI, should result in speedup 
see https://github.com/karlicoss/HPI/issues/391
 2024-09-23 01:22:16 +01:00
Dima Gerasimov
8ed9e1947e my.youtube.takeout: deduplicate watched videos and sort out a few minor errors 2024-09-22 23:46:41 +01:00
Dima Gerasimov
75639a3d5e tox: some prep for potentially using uv on CI instead of pip 
see https://github.com/karlicoss/HPI/issues/391
 2024-09-22 20:10:52 +01:00
Dima Gerasimov
3166109f15 my.core: fix list constructor in always_support_sequence and add some tests 2024-09-22 04:35:30 +01:00
Dima Gerasimov
02dabe9f2b my.twitter.archive: cleanup linting and use proper configuration via abstract class 2024-09-22 02:13:10 +01:00
Dima Gerasimov
239e6617fe my.twitter.archive: deduplicate tweets based on id_str/created_at and raw tweet text 2024-09-22 02:13:10 +01:00
Dima Gerasimov
e036cc9e85 my.twitter.android: get own user id as string, consistent with rest of module 2024-09-22 02:13:10 +01:00
Dima Gerasimov
2ca323da84 my.fbmessenger.android: exclude unsent messages to avoid duplication 2024-09-21 23:25:25 +01:00
Dima Gerasimov
6a18f47c37 my.github.gdpr/my.zulip.organization: use kompress support for tar.gz if it's available 
otherwise fall back onto unpacking into tmp dir via my.core.structure
 2024-09-18 23:35:03 +01:00
Dima Gerasimov
201ddd4d7c my.core.structure: add support for .tar.gz archives 
this will be useful to migrate .tar.gz processing to kompress in a backwards compatible way, or to run them against unpacked folder structure if user prefers
 2024-09-17 00:25:17 +01:00
Dima Gerasimov
27178c0939 my.google.takeout.parser: speedup event merging on newer google_takeout_parser versions 2024-09-13 02:31:12 +01:00
Dima Gerasimov
71fdeca5e1 ci: update mypy config and make ruff config more consistent with other projects 2024-08-31 02:17:49 +01:00
Dima Gerasimov
d58453410c ruff: process remaining existing checks and suppress the annoying ones 2024-08-28 04:06:32 +01:00
Dima Gerasimov
1c5efc46aa ruff: enable TRY rules 2024-08-28 04:06:32 +01:00
Dima Gerasimov
affa79ba3a my.time.tz.via_location: fix accidental RuntimeError introduced in previous MR 2024-08-28 04:06:32 +01:00
Dima Gerasimov
fc0e0be291 ruff: enable ICN and PD rules 2024-08-28 04:06:32 +01:00
Dima Gerasimov
c5df3ce128 ruff: enable W, COM, EXE rules 2024-08-28 04:06:32 +01:00
Dima Gerasimov
ac08af7aab ruff: enable PT (pytest) rules 2024-08-28 04:06:32 +01:00
Dima Gerasimov
9fd4227abf ruff: enable RET/PIE/PLW 2024-08-28 04:06:32 +01:00
Dima Gerasimov
bd1e5d2f11 ruff: enable PERF checks set 2024-08-28 04:06:32 +01:00
Dima Gerasimov
985c0f94e6 ruff: attempt to enable ARG checks, suppress in some places 2024-08-28 04:06:32 +01:00
Dima Gerasimov
72cc8ff3ac ruff: enable B warnings (mainly suppressed exceptions and unused variables) 2024-08-28 04:06:32 +01:00
Dima Gerasimov
d0df8e8f2d ruff: enable PLR rules and fix bug in my.github.gdpr._is_bot 2024-08-28 04:06:32 +01:00
Dima Gerasimov
b594377a59 ruff: enable RUF ruleset 2024-08-28 04:06:32 +01:00
Dima Gerasimov
664c40e3e8 ruff: enable FBT rules to detect boolean arguments use without kwargs 2024-08-28 04:06:32 +01:00
Dima Gerasimov
118c2d4484 ruff: enable UP ruleset for detecting python deprecations 2024-08-28 04:06:32 +01:00
Dima Gerasimov
d244c7cc4e ruff: enable and fix C4 ruleset 2024-08-28 04:06:32 +01:00
Dima Gerasimov
c08ddbc781 general: small updates for typing while trying out pyright 2024-08-28 04:06:32 +01:00
Dima Gerasimov
b1fe23b8d0 my.rss.feedly/my.twittr.talon -- migrate to use lazy user configs 2024-08-26 04:00:58 +01:00
Dima Gerasimov
b87d1c970a tests: move remaining tests from tests/ to my.tests, cleanup corresponding modules 2024-08-26 04:00:58 +01:00
Dima Gerasimov
a5643206a0 general: make time.tz.via_location user config lazy, move tests to my.tests package 
also gets rid of the problematic reset_modules thingie
 2024-08-26 04:00:58 +01:00
Dima Gerasimov
270080bd56 core.error: better defensive handling for my.core.source when parts of config are missing 2024-08-26 04:00:58 +01:00
Dima Gerasimov
094519acaf tests: disable cachew in my.tests subpackage 2024-08-26 04:00:58 +01:00
Dima Gerasimov
7cae9d5bf3 my.google.takeout.paths: migrate to new style lazy config 
also clean up tests a little and move into my.tests.location.google
 2024-08-26 04:00:58 +01:00
Dima Gerasimov
2ff2dcfc00 tests: move test checkign for my_config handling to core/tests/test_config.py 
allows to remove the hacky reset_modules thing from setup fixture
 2024-08-25 20:49:56 +01:00
Dima Gerasimov
1215181af5 core: move stuff from tests/demo.py to my/core/tests/test_config.py 
also clean all this up a bit
 2024-08-25 20:49:56 +01:00
Dima Gerasimov
5a67f0bafe pdfs: migrate config to Protocol with properties 
allowes to remove a whole bunch of hacky crap from tests!
 2024-08-25 20:49:56 +01:00
Dima Gerasimov
d154825591 my.bluemaestro: make config construction lazy 
following the discussions here: https://github.com/karlicoss/HPI/issues/46#issuecomment-2295464073
 2024-08-25 20:49:56 +01:00