Commit graph

53 commits

Author SHA1 Message Date
Dima Gerasimov
d244c7cc4e ruff: enable and fix C4 ruleset 2024-08-28 04:06:32 +01:00
Dima Gerasimov
973c4205df core: cleanup deprecations, exclude from type checking and show runtime warnings
among affected things:

- core.common.assert_never
- core.common.cproperty
- core.common.isoparse
- core.common.mcachew
- core.common.the
- core.common.tzdatetime
- core.compat.sqlite_backup
2024-08-16 10:22:29 +01:00
Dima Gerasimov
103ea2096e my.coding.commits: fix for git repo discovery after fdfind v9 2024-03-13 00:46:18 +00:00
karlicoss
7b1cec9326 codeforces/topcode: move to top level and check in ci 2023-11-10 23:11:54 +00:00
Dima Gerasimov
fe88380499 general: switch to using native 3.8 versions for cached_property/Literal/Protocol instead of compat 2023-05-16 01:18:30 +01:00
Dima Gerasimov
c34656e8fb general: update mypy config, seems that logs of type: ignore aren't necessary anymore 2023-05-16 01:18:30 +01:00
Kian-Meng Ang
d2ef23fcb4 docs: fix typos
found via `codespell -L copie,datas,pres,fo,tooks,noo,ue,ket,frop`
2023-03-27 03:02:35 +01:00
Dima Gerasimov
c63177e186 general/ci: clean up mypy-misc pipeline, only exclude specific files instead
marked some module configs which aren't really ready for public use as type: ignore
2023-02-21 00:20:58 +00:00
Dima Gerasimov
2025d7ad1a general: minor cleanup
- get rid of unnecessary globs in get_files (they should be in config if the user wishes)
- get rid of some old kython imports
- do not convert Path twice in foursquare (so CPath works correctly)
2022-05-31 22:16:05 +01:00
Dima Gerasimov
4e59a65f9a core/general: move cached_property into compat, use standard implementation from python3.8 2022-05-31 14:08:50 +01:00
Dima Gerasimov
b54ec0d7f1 ci: fix minor mypy complaints from gitpython 2021-10-29 01:41:44 +01:00
Sean Breckenridge
f559e7cb89 my.coding.commits: fix misspelling/add warning 2021-04-07 19:59:27 +01:00
Sean Breckenridge
5ecd4b4810 cleanup; remove unused imports 2021-04-02 08:38:06 +01:00
Sean Breckenridge
a11a3af597 commits: reduce possibility of path conflicts 2021-04-02 07:20:35 +01:00
Dima Gerasimov
a1a24ffbc3 my.coding.commits: more cleanup
Followup of https://github.com/karlicoss/HPI/pull/132

- add REQUIRES section
- use 'commits' config section & add proper schema
- use dedicated subdirectory for cache
2021-03-15 10:33:46 +00:00
Sean Breckenridge
4db81ca362
cleanup coding.commits (#132)
* cleanup coding.commits

remove the _things check, its never activated
for me and seems pointless

update mechanism for finding fdfind/fd path,
send a core.warning if it fails

update mechanism to cache repos to new cachew
api (remove hashf), cache repos on a per-repo
basis
2021-03-15 03:55:28 +00:00
Dima Gerasimov
655b86bb0a my.kython.konsume: move to core 2020-10-29 03:13:18 +01:00
Dima Gerasimov
821eb47c93 kobo: BREAKING changes. Use kobuddy module directly, rename export_dir to export_path.
Hopefully this makes a lot of sense in the first place, and not that many users, so deserves breaking.
2020-06-04 22:50:52 +01:00
Dima Gerasimov
ca39187c63 github: DEPRECATE my.coding.github
Instead my.github.all should be used (still backward compatible)

The reasons are
a) I don't feel that grouping (i.e. my.coding.*) makes much sense
b) using .all pattern (same way as twitter) allows for more composable and cleaner separation of GDPR and API data
2020-06-01 22:49:31 +01:00
Dima Gerasimov
d7aff1be3f github: start moving to a proper artbitrated module 2020-06-01 22:49:31 +01:00
Matthew Reishus
67cf4d0c04 my.coding.github ignores some events emitted by bots.
I use a service called dependabot ( https://dependabot.com/ ).  It
automatically creates pull requests in my repositories to upgrade
dependencies.  The modern front end javascript world moves really
quickly; projects have a ton of dependencies that are updating all the
time, so there are a lot of these pull requests.

Also, the PRs it makes have a lot of info in them.  Here's an example
one: https://github.com/mreishus/spades/pull/180 .  If you hit the
arrows, you can see it includes a lot of text in "Changelog" and
"Commits".  Now check out the list of closed PRs this project has:
https://github.com/mreishus/spades/pulls?q=is%3Apr+is%3Aclosed

Once I got everything working with my.coding.github, my Github.org
(using orger) was huge: 5MB.  I wanted to get rid of the dependabot
stuff, since it's mostly junk I'm not too interested it, and I got it
down to 130K (from 5MB) just from this commit.

Here's an example of an event I'm filtering out:
I'm looking to see if the "user" contains a "[bot]" tag in it.

  {
    "type": "pull_request",
    "url": "https://github.com/mreishus/spades/pull/96",
    "user": "https://github.com/dependabot-preview[bot]",
    "repository": "https://github.com/mreishus/spades",
    "title": "Bump axios from 0.19.1 to 0.19.2 in /frontend",
    "body": "Bumps [axios](https://github.com/axios/axios) from 0.19.1 to 0.19.2.\n<details>\n<summary>Release notes</summary [cut 5000 characters]
    "base": {
      "ref": "master",
      "sha": "a47687762887c6e5c0d5d0a38c3c9697f09cbcd6",
      "user": "https://github.com/mreishus",
      "repo": "https://github.com/mreishus/spades"
    },
    "head": {
      "ref": "dependabot/npm_and_yarn/frontend/axios-0.19.2",
      "sha": "0e79d0220002cb54cd40e13a40addcc0d0a01482",
      "user": "https://github.com/mreishus",
      "repo": "https://github.com/mreishus/spades"
    },
    "assignee": "https://github.com/mreishus",
    "assignees": [
      "https://github.com/mreishus"
    ],
    "milestone": null,
    "labels": [
      "https://github.com/mreishus/spades/labels/dependencies",
      "https://github.com/mreishus/spades/labels/javascript"
    ],
    "review_requests": [

    ],
    "work_in_progress": false,
    "merged_at": null,
    "closed_at": "2020-01-25T14:40:27Z",
    "created_at": "2020-01-22T13:37:17Z"
  },

Maybe this should be a config option, but I didn't know how to make them
cleanly in HPI, and I'm not sure if anyone would ever want this stuff.
2020-06-01 16:22:07 +01:00
Dima Gerasimov
9d5d368891 get rid of unnecessary .init imports 2020-05-06 22:05:16 +01:00
Dima Gerasimov
3912ef2460 fix zstd handling and github wrapper 2020-05-04 19:52:18 +01:00
Dima Gerasimov
a521885aa0 prettify github extractors 2020-05-03 10:08:53 +01:00
Dima Gerasimov
51ae8601b4 Update docstrings and add links 2020-04-26 16:50:06 +01:00
Dima Gerasimov
e5b3a1e91e use my.config instead of mycfg; minor cleanups and docstrings 2020-04-12 00:22:10 +01:00
Dima Gerasimov
09a0c8eb28 handle more fixmes, add make_dict 2020-03-24 21:15:21 +01:00
Dima Gerasimov
094c775480 use cachew in my.commits 2020-03-14 11:24:21 +00:00
Dima Gerasimov
cec7cad2bf emit only unique commits 2020-03-14 10:35:30 +00:00
Dima Gerasimov
150688d9bd handle bare/non bare repos properly 2020-03-14 10:33:04 +00:00
Dima Gerasimov
d2ef972416 prettify and simplify my.commits 2020-03-14 10:32:48 +00:00
Dima Gerasimov
59fc098b68 WIP on automatic repository discovery 2020-03-14 09:12:37 +00:00
Dima Gerasimov
083054e740 move commits into my. hierarchy 2020-03-13 23:01:31 +00:00
Dima Gerasimov
d00e09d1a1 More module descriptions 2020-02-26 16:32:03 +01:00
Dima Gerasimov
e3b3b12ff1 add more stuff to kompress; less kython deps 2020-02-01 15:17:13 +00:00
Dima Gerasimov
232d62b3b7 rename model -> dal for github 2020-01-27 22:04:38 +00:00
Dima Gerasimov
9cfcc3373f fix model -> dal rename 2020-01-26 22:36:19 +00:00
Dima Gerasimov
34bd2356ae update paths to data access layers 2020-01-10 23:37:21 +00:00
Dima Gerasimov
5611fce720 Use defensive cachew 2020-01-07 00:12:49 +00:00
Dima Gerasimov
cf087ae316 adapt codeforces/topcoder data from private package 2019-12-24 23:22:17 +00:00
Dima Gerasimov
066641a4ce Rename my_configuration to mycfg for brevity 2019-12-19 20:14:26 +00:00
Dima Gerasimov
da758abaf0 use cachew for events 2019-12-08 10:31:11 +00:00
Dima Gerasimov
e9152d055c fix mypy 2019-12-06 23:28:06 +00:00
Dima Gerasimov
9fc2c29779 better merging 2019-12-06 23:22:10 +00:00
Dima Gerasimov
23faedb8c0 basic event merging 2019-12-06 22:57:46 +00:00
Dima Gerasimov
ed25ee91bf handle remaining gdpr files 2019-12-06 22:41:56 +00:00
Dima Gerasimov
2d1a0b7732 handle new issues 2019-12-06 22:28:19 +00:00
Dima Gerasimov
db76eafb44 handle issue comments 2019-12-06 22:10:40 +00:00
Dima Gerasimov
841454b1fe initial GDPR events parsing 2019-12-06 21:57:37 +00:00
Dima Gerasimov
4ca872f711 standartize use of my_configuration in github 2019-12-06 21:07:25 +00:00