fz0x1/HPI
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
582 commits 3 branches 41 tags 2.5 MiB
Commit graph

23 commits

Author SHA1 Message Date
Dima Gerasimov
ca39187c63 github: DEPRECATE my.coding.github 
Instead my.github.all should be used (still backward compatible)

The reasons are
a) I don't feel that grouping (i.e. my.coding.*) makes much sense
b) using .all pattern (same way as twitter) allows for more composable and cleaner separation of GDPR and API data
 2020-06-01 22:49:31 +01:00
Dima Gerasimov
d7aff1be3f github: start moving to a proper artbitrated module 2020-06-01 22:49:31 +01:00
Matthew Reishus
67cf4d0c04 my.coding.github ignores some events emitted by bots. 
I use a service called dependabot ( https://dependabot.com/ ).  It
automatically creates pull requests in my repositories to upgrade
dependencies.  The modern front end javascript world moves really
quickly; projects have a ton of dependencies that are updating all the
time, so there are a lot of these pull requests.

Also, the PRs it makes have a lot of info in them.  Here's an example
one: https://github.com/mreishus/spades/pull/180 .  If you hit the
arrows, you can see it includes a lot of text in "Changelog" and
"Commits".  Now check out the list of closed PRs this project has:
https://github.com/mreishus/spades/pulls?q=is%3Apr+is%3Aclosed

Once I got everything working with my.coding.github, my Github.org
(using orger) was huge: 5MB.  I wanted to get rid of the dependabot
stuff, since it's mostly junk I'm not too interested it, and I got it
down to 130K (from 5MB) just from this commit.

Here's an example of an event I'm filtering out:
I'm looking to see if the "user" contains a "[bot]" tag in it.

  {
    "type": "pull_request",
    "url": "https://github.com/mreishus/spades/pull/96",
    "user": "https://github.com/dependabot-preview[bot]",
    "repository": "https://github.com/mreishus/spades",
    "title": "Bump axios from 0.19.1 to 0.19.2 in /frontend",
    "body": "Bumps [axios](https://github.com/axios/axios) from 0.19.1 to 0.19.2.\n<details>\n<summary>Release notes</summary [cut 5000 characters]
    "base": {
      "ref": "master",
      "sha": "a47687762887c6e5c0d5d0a38c3c9697f09cbcd6",
      "user": "https://github.com/mreishus",
      "repo": "https://github.com/mreishus/spades"
    },
    "head": {
      "ref": "dependabot/npm_and_yarn/frontend/axios-0.19.2",
      "sha": "0e79d0220002cb54cd40e13a40addcc0d0a01482",
      "user": "https://github.com/mreishus",
      "repo": "https://github.com/mreishus/spades"
    },
    "assignee": "https://github.com/mreishus",
    "assignees": [
      "https://github.com/mreishus"
    ],
    "milestone": null,
    "labels": [
      "https://github.com/mreishus/spades/labels/dependencies",
      "https://github.com/mreishus/spades/labels/javascript"
    ],
    "review_requests": [

    ],
    "work_in_progress": false,
    "merged_at": null,
    "closed_at": "2020-01-25T14:40:27Z",
    "created_at": "2020-01-22T13:37:17Z"
  },

Maybe this should be a config option, but I didn't know how to make them
cleanly in HPI, and I'm not sure if anyone would ever want this stuff.
 2020-06-01 16:22:07 +01:00
Dima Gerasimov
9d5d368891 get rid of unnecessary .init imports 2020-05-06 22:05:16 +01:00
Dima Gerasimov
3912ef2460 fix zstd handling and github wrapper 2020-05-04 19:52:18 +01:00
Dima Gerasimov
a521885aa0 prettify github extractors 2020-05-03 10:08:53 +01:00
Dima Gerasimov
e5b3a1e91e use my.config instead of mycfg; minor cleanups and docstrings 2020-04-12 00:22:10 +01:00
Dima Gerasimov
d00e09d1a1 More module descriptions 2020-02-26 16:32:03 +01:00
Dima Gerasimov
e3b3b12ff1 add more stuff to kompress; less kython deps 2020-02-01 15:17:13 +00:00
Dima Gerasimov
232d62b3b7 rename model -> dal for github 2020-01-27 22:04:38 +00:00
Dima Gerasimov
9cfcc3373f fix model -> dal rename 2020-01-26 22:36:19 +00:00
Dima Gerasimov
34bd2356ae update paths to data access layers 2020-01-10 23:37:21 +00:00
Dima Gerasimov
5611fce720 Use defensive cachew 2020-01-07 00:12:49 +00:00
Dima Gerasimov
066641a4ce Rename my_configuration to mycfg for brevity 2019-12-19 20:14:26 +00:00
Dima Gerasimov
da758abaf0 use cachew for events 2019-12-08 10:31:11 +00:00
Dima Gerasimov
e9152d055c fix mypy 2019-12-06 23:28:06 +00:00
Dima Gerasimov
9fc2c29779 better merging 2019-12-06 23:22:10 +00:00
Dima Gerasimov
23faedb8c0 basic event merging 2019-12-06 22:57:46 +00:00
Dima Gerasimov
ed25ee91bf handle remaining gdpr files 2019-12-06 22:41:56 +00:00
Dima Gerasimov
2d1a0b7732 handle new issues 2019-12-06 22:28:19 +00:00
Dima Gerasimov
db76eafb44 handle issue comments 2019-12-06 22:10:40 +00:00
Dima Gerasimov
841454b1fe initial GDPR events parsing 2019-12-06 21:57:37 +00:00
Dima Gerasimov
4ca872f711 standartize use of my_configuration in github 2019-12-06 21:07:25 +00:00
Renamed from my/coding/github/__init__.py (Browse further)