[Qgis-psc] Moving tickets to GitHub - status update?

[Richard Duivenvoorde]

On 21-06-16 14:18, Matthias Kuhn wrote:
>> FYI: I just sent a support email to Github, to temporarily lift the
>> > throttle or other ideas/scripts to help us...
> I have done that 2 months ago already:
> 
>  * No throttle lift (not even temporary)
>  * There is another API which is better suited which will help us to do
> the migration in < 5 hours.
> 
> Let me know if you get more info than that.

Below what I just received from github
(a little different, not sure if it is helpfull):

-------- Forwarded Message --------
Subject: 	Re: Temporarily lift api-throtteling
Date: 	Tue, 21 Jun 2016 09:41:30 -0700
From: 	Francis (GitHub Staff) <support at github.com>
To: 	Richard Duivenvoorde <richard at duif.net>

Hi Richard,

Thanks for writing in!

You asked:

      * is it possible to have a lift of the api throtteling for some
        weeks, so we can test/import stuff. After that we are ok with
        the 'normal' regime...

If the need arises, we can offer a temporary rate limit increase for a
specific OAuth application [1]. In other words, this would be help for
the short-term (not something permanent, typically a few days, 2-3x the
normal rate limit), and it would be applied to your OAuth application
only. If you don't have an OAuth application, then you can create one,
create an OAuth token for that application [2] and then use that token
to make authenticated requests.

However, we rarely provide this increase to projects that intend to
collect lots of data about Git objects (commits, tags, files,
contributors). The reason for this is that operations for fetching
Git-related data are very expensive to compute.

To help us assess your request, we'd need to ask a few questions about
your needs:

 1.

    Could you please explain which API endpoints you're using exactly,
    and the frequency at which you're making requests to each endpoint?

 2.

    Based on your answer above, do you have an estimate of how many API
    calls you're going to need to make per hour to each of those routes,
    and for how long you'll need to make calls at this rate?

 3.

    Are you already making authenticated calls [3], which gives you a
    5000 reqs/hour rate limit [4]?

 4.

    Is there a way you could utilize conditional requests [5] or
    webhooks [6] to optimize your usage of the API?

You also asked:

      * do you have scripts/experience for importing Redmine issues into
        github?

Neither the GitHub Help Documentation (help.github.com) nor GitHub
Developer Documentation (developer.github.com) have any scripts for
importing Redmine issues into GitHub. Our team would be happy to support
any of your questions on the Git and GitHub side of things, but we don't
provide services for Redmine since it's not something we built.

Let me know if you have any other questions. Thanks Richard!

All the best,
Francis

[1] http://developer.github.com/v3/oauth/
[2]
https://developer.github.com/v3/oauth_authorizations/#create-a-new-authorization
[3] http://developer.github.com/v3/#authentication
[4] http://developer.github.com/v3/#rate-limiting
[5] http://developer.github.com/v3/#conditional-requests
[6] https://developer.github.com/webhooks/

------------------------------------------------------------------------

    Hi,

    we are a OpenSource-community ( http://qgis.org,
    http://github.com/qgis ) and have discussion about moving our issues
    from our own Redmine instance to Github (or not...).

    one of the problems we have is that community members trying to run
    export/import scripts are limited/fail because of the api
    throtteling (we have a lot of issues, want to bring them all in, AND
    want to add as much info as possible over).

    So questions:

      *

        is it possible to have a lift of the api throtteling for some
        weeks, so we can test/import stuff. After that we are ok with
        the 'normal' regime...

      *

        do you have scripts/experience for importing Redmine issues into
        github?

    We currently try this scripts:

    https://github.com/m-kuhn/rm2gh

    If you want to read about the discussions:

    https://lists.osgeo.org/pipermail/qgis-psc/2016-June/004480.html

    Regards,

    Richard Duivenvoorde