Github Downloads going away...

I'll definitely walk down the hall and talk to my local Numfocus board member :wink:

As for S3, their free tier is clearly insufficient -- I thought I'd get a hold on the cost of paying for it.

Our storage requirements are ~150MB per release (for all of the different binaries) (though likely to grow over time), so saying it's useful to have the last ~6 or so releases live at any given time, that's ~900MB -- let's call it 1GB.

Our transfer requirements after a release seem to peak at around 1.7TB/mo, about 67,000 requests, after a release (though presumably amortized over time, it's lower). This is also likely to grow over time, of course.

So, I think we've got:

1,700 GB transfer @ $0.12/GB = $204.00
70,000 requests $0.01/10,000 = $0.07
1GB storage @ $0.095 = $0.10

That's a bit steep to cover with donations alone.

In any event, this is a useful assessment of what this is really worth (and what our eyeballs are worth to advertisers on Sourceforge :wink:

Perhaps, as Skipper suggests, with a little investment in automation tools for SourceForge that may remain the best option. The Sourceforge download experience isn't terrible if we provide direct links to the downloads on our own website. wxPython has done this for years, and AFAIK they have not run in to any problems. The links even work without a web browser (though, for example, wget and curl).

Cheers,
Mike

···

On 12/16/2012 03:44 PM, Eric Firing wrote:

On 2012/12/16 9:21 AM, Damon McDougall wrote:

On Sat, Dec 15, 2012 at 8:25 PM, Jason Grout >> <jason-sage@...691...> wrote:

On 12/14/12 10:55 AM, Nathaniel Smith wrote:

sourceforge's horror of an interface.

I'll second that. Every time I go to Sourceforge, I have to figure out
how in the world to download what I want (and I have to figure out which
things *not* to click on too).

Ok sounds like there is a reasonable amount of resistance towards Sourceforge.

Eric, when you suggest that NumFocus could 'provide hosting directly',
do you mean they would have the physical hardware to host the files,
or are you suggesting they provide the finances to seek hosting
elsewhere?

I was thinking that perhaps NumFocus would be running a server that
could provide the hosting. Funding for an external service is also
possible, though, and might make more sense.

2012/12/16 Thomas Kluyver <thomas@...1071...>:

Maybe the best thing is to host the binaries on Sourceforge.

Having recently tried to do it, Sourceforge tries really hard to avoid
giving you a direct link that can repeatably be used to download a file
automatically, i.e. without a browser. In the case I was after it for, I
ended up downloading the file (a PyWin32 binary) with a browser, and storing
it on the CI server that I wanted to install it.

I haven't followed this thread in detail, so not sure if it's really
relevant: I agree that it's quite messy, but it's definitely possible
to find stable download links for automated downloads from
sourceforge. I sometimes need this because I use a ports-like system
for installing certain packages from source on top of my regular
Ubuntu system, and it does work quite well. So if this is what's
keeping people from Sourceforge then there are definitely workarounds
(give me a shout if you need more specific information; I'm likely to
have very sporadic internet access over the next few weeks though, so
replies may take a while). However, I also think Sourceforge's
interface is really ugly so if there are better alternatives then
that's great. :slight_smile:

Cheers,
Max

···

On 15 December 2012 23:38, Damon McDougall <damon.mcdougall@...149...> > wrote:

I thought I would just throw this out there, and I’m not entirely sure it would work, but here goes…

What about using something like Dropbox? Create a matplotlib account, put the binaries in a Public folder and then use that as the storage…I don’t know how this would work in practice, but I do know that people have been using Dropbox to host things for websites in other venues (persontal blogs, etc)

It’s probably best to talk to Dropbox first, but since they are built on Python, they might be willing to work with open source Python projects.

PTM

···

Patrick Marsh
Ph.D. Candidate / Liaison to the HWT
School of Meteorology / University of Oklahoma
Cooperative Institute for Mesoscale Meteorological Studies
National Severe Storms Laboratory

http://www.patricktmarsh.com

On Mon, Dec 17, 2012 at 7:33 AM, Maximilian Albert <maximilian.albert@…149…> wrote:

2012/12/16 Thomas Kluyver <thomas@…55…1071…>:

On 15 December 2012 23:38, Damon McDougall <damon.mcdougall@…149…> > > > wrote:

Maybe the best thing is to host the binaries on Sourceforge.

Having recently tried to do it, Sourceforge tries really hard to avoid

giving you a direct link that can repeatably be used to download a file

automatically, i.e. without a browser. In the case I was after it for, I

ended up downloading the file (a PyWin32 binary) with a browser, and storing

it on the CI server that I wanted to install it.

I haven’t followed this thread in detail, so not sure if it’s really

relevant: I agree that it’s quite messy, but it’s definitely possible

to find stable download links for automated downloads from

sourceforge. I sometimes need this because I use a ports-like system

for installing certain packages from source on top of my regular

Ubuntu system, and it does work quite well. So if this is what’s

keeping people from Sourceforge then there are definitely workarounds

(give me a shout if you need more specific information; I’m likely to

have very sporadic internet access over the next few weeks though, so

replies may take a while). However, I also think Sourceforge’s

interface is really ugly so if there are better alternatives then

that’s great. :slight_smile:

Cheers,

Max


LogMeIn Rescue: Anywhere, Anytime Remote support for IT. Free Trial

Remotely access PCs and mobile devices and provide instant support

Improve your efficiency, and focus on delivering more value-add services

Discover what IT Professionals Know. Rescue delivers

http://p.sf.net/sfu/logmein_12329d2d


Matplotlib-devel mailing list

Matplotlib-devel@lists.sourceforge.net

https://lists.sourceforge.net/lists/listinfo/matplotlib-devel

At the 6th Annual Scientific Software Day here at UT Austin, I met and
spoke to Travis Oliphant regarding funding for hosting our binaries.
Travis has links with NumFOCUS and was eager to help the matplotlib
community host binaries should we choose to not go with sourceforge or
another free option.

I'll need touch base with him again to get specifics, but I thought
I'd just let everyone here know that that's still an option.

To be honest with you, I'm thinking that if we only want to link to
binaries from the matplotlib web page then sourceforge really doesn't
sound like a bad option at all.

···

On Mon, Dec 17, 2012 at 8:10 AM, Michael Droettboom <mdroe@...31...> wrote:

On 12/16/2012 03:44 PM, Eric Firing wrote:

On 2012/12/16 9:21 AM, Damon McDougall wrote:

On Sat, Dec 15, 2012 at 8:25 PM, Jason Grout >>> <jason-sage@...691...> wrote:

On 12/14/12 10:55 AM, Nathaniel Smith wrote:

sourceforge's horror of an interface.

I'll second that. Every time I go to Sourceforge, I have to figure out
how in the world to download what I want (and I have to figure out which
things *not* to click on too).

Ok sounds like there is a reasonable amount of resistance towards Sourceforge.

Eric, when you suggest that NumFocus could 'provide hosting directly',
do you mean they would have the physical hardware to host the files,
or are you suggesting they provide the finances to seek hosting
elsewhere?

I was thinking that perhaps NumFocus would be running a server that
could provide the hosting. Funding for an external service is also
possible, though, and might make more sense.

I'll definitely walk down the hall and talk to my local Numfocus board
member :wink:

--
Damon McDougall
http://www.damon-is-a-geek.com
Institute for Computational Engineering Sciences
201 E. 24th St.
Stop C0200
The University of Texas at Austin
Austin, TX 78712-1229

Or -- I'll just point this out one more time then leave the dead horse
alone :slight_smile: -- you could just register a project called
'matplotlib-downloads' on google code hosting, and have static URLs
that look like e.g.
  https://apa6e.googlecode.com/files/apa6e-v0.3.zip
and let Google foot the bill for reliable high-bandwidth CDN hosting.

-n

···

On Sun, Dec 23, 2012 at 12:42 AM, Damon McDougall <damon.mcdougall@...149...> wrote:

On Mon, Dec 17, 2012 at 8:10 AM, Michael Droettboom <mdroe@...31...> wrote:

On 12/16/2012 03:44 PM, Eric Firing wrote:

On 2012/12/16 9:21 AM, Damon McDougall wrote:

On Sat, Dec 15, 2012 at 8:25 PM, Jason Grout >>>> <jason-sage@...691...> wrote:

On 12/14/12 10:55 AM, Nathaniel Smith wrote:

sourceforge's horror of an interface.

I'll second that. Every time I go to Sourceforge, I have to figure out
how in the world to download what I want (and I have to figure out which
things *not* to click on too).

Ok sounds like there is a reasonable amount of resistance towards Sourceforge.

Eric, when you suggest that NumFocus could 'provide hosting directly',
do you mean they would have the physical hardware to host the files,
or are you suggesting they provide the finances to seek hosting
elsewhere?

I was thinking that perhaps NumFocus would be running a server that
could provide the hosting. Funding for an external service is also
possible, though, and might make more sense.

I'll definitely walk down the hall and talk to my local Numfocus board
member :wink:

At the 6th Annual Scientific Software Day here at UT Austin, I met and
spoke to Travis Oliphant regarding funding for hosting our binaries.
Travis has links with NumFOCUS and was eager to help the matplotlib
community host binaries should we choose to not go with sourceforge or
another free option.

I'll need touch base with him again to get specifics, but I thought
I'd just let everyone here know that that's still an option.

To be honest with you, I'm thinking that if we only want to link to
binaries from the matplotlib web page then sourceforge really doesn't
sound like a bad option at all.

Thanks for reminding us about the google code option. Since there are
quite a lot of suggestions I've used this opportunity to write a short
summary of the options presented in this thread:

Google Code: Free. Interface is better than sourceforge.

Sourceforge: Free. Ugly. May not need interface if hotlinking to
binaries from the website.

PyPI: Free. Size quota too small. Will link to external files.

S3: Free and not free. We're over the free tier quota. NumFOCUS can
potentially fund the non-free tier (cost is circa $200/mo). I thought
it was $200/yr. IMO $200/mo is very expensive.

gh-pages: We're already over the size limit for this branch.

new gh repo: Free. 1GB of space.
About large files on GitHub - GitHub Docs. Will hold
about 4 releases?

Dropbox: Free 2GB account. Can hotlink to binaries.

···

On Sun, Dec 23, 2012 at 2:24 PM, Nathaniel Smith <njs@...503...> wrote:

On Sun, Dec 23, 2012 at 12:42 AM, Damon McDougall > <damon.mcdougall@...149...> wrote:

On Mon, Dec 17, 2012 at 8:10 AM, Michael Droettboom <mdroe@...31...> wrote:

On 12/16/2012 03:44 PM, Eric Firing wrote:

On 2012/12/16 9:21 AM, Damon McDougall wrote:

On Sat, Dec 15, 2012 at 8:25 PM, Jason Grout >>>>> <jason-sage@...691...> wrote:

On 12/14/12 10:55 AM, Nathaniel Smith wrote:

sourceforge's horror of an interface.

I'll second that. Every time I go to Sourceforge, I have to figure out
how in the world to download what I want (and I have to figure out which
things *not* to click on too).

Ok sounds like there is a reasonable amount of resistance towards Sourceforge.

Eric, when you suggest that NumFocus could 'provide hosting directly',
do you mean they would have the physical hardware to host the files,
or are you suggesting they provide the finances to seek hosting
elsewhere?

I was thinking that perhaps NumFocus would be running a server that
could provide the hosting. Funding for an external service is also
possible, though, and might make more sense.

I'll definitely walk down the hall and talk to my local Numfocus board
member :wink:

At the 6th Annual Scientific Software Day here at UT Austin, I met and
spoke to Travis Oliphant regarding funding for hosting our binaries.
Travis has links with NumFOCUS and was eager to help the matplotlib
community host binaries should we choose to not go with sourceforge or
another free option.

I'll need touch base with him again to get specifics, but I thought
I'd just let everyone here know that that's still an option.

To be honest with you, I'm thinking that if we only want to link to
binaries from the matplotlib web page then sourceforge really doesn't
sound like a bad option at all.

Or -- I'll just point this out one more time then leave the dead horse
alone :slight_smile: -- you could just register a project called
'matplotlib-downloads' on google code hosting, and have static URLs
that look like e.g.
  https://apa6e.googlecode.com/files/apa6e-v0.3.zip
and let Google foot the bill for reliable high-bandwidth CDN hosting.

-n

--
Damon McDougall
http://www.damon-is-a-geek.com
Institute for Computational Engineering Sciences
201 E. 24th St.
Stop C0200
The University of Texas at Austin
Austin, TX 78712-1229