Commons:Upload Wizard feedback/Archive/2019/05

Could anyone recommend me a browser to upload with this???

I'm planning to upload ~150 WebM videos (1.27 GB each) with this, tried Firefox, Chromium, GNOME-Web (each attempt takes a day to upload), always crashes after licensing. Special:UploadStash doesn't work. Commons:Upload tools#Standalone desktop applications tried all these tools without success (so frustrated after finding out they don't work -- I have managed to fill all the fields ie. name, description etc; they have long been unmaintained, either). I'm using Lubuntu 18.04.2 LTS 64bit with 4 GiB RAM, 15GiB swap.

Could anyone help me??? Thanks in advance.

Tomskyhaha (talk) 02:03, 8 May 2019 (UTC)

Hi, If your other videos are an indication, you should reduce the bitrate to a reasonable level (30 fps), then the videos won't be so big, and will be much easier to upload. Regards, Yann (talk) 05:51, 8 May 2019 (UTC)

@Yann: Thank you for addressing my concerns, however reducing bitrate is not an option in my case, since the very reason I recorded them in the first place is producing a faithful depiction of the places. The purpose would be defeated if I lowered the bitrate. And IMHO, higher bitrate means better quality, period. Regards Tomskyhaha (talk) 09:03, 8 May 2019 (UTC)

@Yann: In another message you pointed out the video quailty is mediocre, aside from their "small segment" nature, you might also want to give "original file" link a try, since the player defaulted streaming quality to WebM 360p. Regards Tomskyhaha (talk) 09:07, 8 May 2019 (UTC)

@Yann: A kind reminder: 30fps isn't bitrate, it's refresh rate. fps stands for "frame per second". The units for bitrate are Mbps, Kbps etc. Please ping me in reply, so I can receive a timely notification. Thanks Tomskyhaha (talk) 09:18, 8 May 2019 (UTC)

@Tomskyhaha: In the 2 samples you mentioned 120 fps (yes, refresh rate, but it doesn't matter for my point). For an ordinary videos like these, the human can't see the difference above 30 fps. So it is useless to record 120 fps, it won't increase the quality, that's mt point. So reducing the refresh rate would reduce the bitrate, and the volume of the video. If you want to increase the quality, you should reduce shaking and improve the contrast. For that you may need a better camera, a tripod, etc. Regards, Yann (talk) 09:35, 8 May 2019 (UTC)

Maybe you may need to follow Help:Server-side upload, if the UploadWizard isn't going to work. When you say "crashing" does the page itself crash, does the upload hang or does the whole browser crash? In the past I have had a large file (~1GB to upload, 4GB of RAM (regardless of how much of a swap you have) it would crash the browser tab (Firefox and Chrome, while Safari would cause a Kernel panic) is likely the problem for my issue but your issue maybe related. Bidgee (talk) 09:40, 8 May 2019 (UTC)

@Yann: Please double-check second sample I gave you, this one https://commons.m.wikimedia.org/wiki/File:102-Road_Bus,_Fanhe,_Tieling_165150002.webm is 120Mbps@30fps, that is 120 Mb per second, 30 frames per second, 3840x2160 resolution. Please differentiate them. Regards and excuse my brevity, I'm replying on my phone. Tomskyhaha (talk) 09:43, 8 May 2019 (UTC)

@Bidgee: Hi Bidgee! Thanks for your reply. Exactly your case, the Upload Wizard tab in Chromium crashes after hanging for about 1 minute. The page says, "Oh snap!", and provides the option to reload the page. I'm afraid the admins won't bother answer me if I request server-side upload. I'm running the Ubuntu on ESXi, maybe I should allocate more mem? Regards Tomskyhaha (talk) 09:50, 8 May 2019 (UTC)

@Tomskyhaha: There are 2 serious issues in this video: the sky is overblown, and it is shaking. Increasing the resolution, or the refresh rate, or the bitrate, won't improve the quality. Regards, Yann (talk) 09:56, 8 May 2019 (UTC)

@Yann: Yes the sky is overexposed, in fact I'm deliberately do so, otherwise the landscape would be too dark. I don't have the resource to buy professional equipments, just doing my best to record it. and so far no one uploaded similar content.

Yes, my recordings have a lot of shortcomings. But better than nothing, right? And because the quailty is already "so bad", no effort should be made to reduce it further. That's my opinion. Regards Tomskyhaha (talk) 10:24, 8 May 2019 (UTC)

@Tomskyhaha: You could also try User:Rillke/bigChunkedUpload.js. Documentation is on the talk page.   — Jeff G. ツ _{please ping or talk to me} 12:48, 8 May 2019 (UTC)

@Jeff G.: Thanks! I'll give it a try later. Regards Tomskyhaha (talk) 15:41, 8 May 2019 (UTC)

@Tomskyhaha: Good luck! I suggest a chunk size between the default 4 MiB and 1% (12.7 MB).   — Jeff G. ツ _{please ping or talk to me} 20:00, 8 May 2019 (UTC)

So I reproduced the problem after 8 hours' waiting; here are the screenshots, hopefully can give some clue for troubleshooting.

This problem occurs when I reach the 50 files per upload limit, trying with fewer files now.

Regards Tomskyhaha (talk) 15:41, 8 May 2019 (UTC)

• 
• 
• 
• 
• 

Finally got 'em uploaded after a week's trying. This won't be possible without you guys!

@Bidgee: @Yann: @Jeff G.: @Clpo13: @4nn1l2: (random order) and OpenCamera developer Mark-h providing WebM video direct high-bitrate capture on Android phones , and of course Geotagged subtitles. (despite lack of audio support, VP 8 codec, inactive development).

Some samples

https://commons.wikimedia.org/wiki/File:102-Road_Bus,_Fanhe_20190410_161336002.webm https://commons.wikimedia.org/wiki/File:102-Road_Bus,_Fanhe_20190410_161336001.webm

All shot on a cheapo $150 phone.

Some segments are missing due to Wizard's quirks, FLAC audio and location subtitles are still yet to be uploaded.

Some thoughts

1. Since I'm no expert in computers, most processing procedures are done by hands, instead of by scripts. Definitely a waste of both time and energy. (and the passion of contributing)

Transfer to NAS.

Split videos up using ffmpeg.

Organize them into newly created folders for easily identifying them later. Don't forget the subtitles!

Upload with the Wizard.

Filling description fields particularly painful!, date of creation can't be extracted automatically from metadata, copypaste every one from file name. In order to preserve the order of splitted up video segments, renaming is done manually

Then hope it doesn't crash in the middle.

2. Maybe a script, which can extract images from videos according to the location given in subtitles, could make the videos more accessible.

It's already 2 a.m. here, time to sleep.

Regards Tomskyhaha (talk) 18:06, 9 May 2019 (UTC)