Nuscenes full version dataset batch download
Requirements: Download the full version of the Nuscenes dataset at high speed. The early adopter version of the mini version was downloaded using the built-in tool of the google browser, which is slow and easy to break.
1. Data address
Official address: https://www.nuscenes.org/nuscenes
2. Get the download link
Reference : How to get the link (path) of the file to be downloaded
Specific steps :
1) Click Asia, and then cancel the download.
2) Click the three-dot control button in the upper right corner of the browser, and then click Downloads.
3) On the pop-up Downloads page, press F12 to open the browser console.
4) Click the square arrow button in the upper left corner of the console, then move the mouse to the address on the left, and a link address will appear on the right.
5) Right-click the link and select Copy Link Address.
3. Make a download script
Reference :
1.ubuntu20.04 batch download NuScenes V1.0 full dataset
2.quick download method of nuScenes dataset under linux system
Select the folder to download, create a new script dataset.sh, the content is as follows, the main format is: wget -c -O [dataset name] [webpage download link].
The lidar modality part of the complete training dataset is downloaded here.
wget -c -O v1.0-trainval01_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval01_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=buHbpzZWUVrSzlvJsSXphQVZd%2B8%3D&Expires=1656905855"
wget -c -O v1.0-trainval02_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval02_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=aCeQIJg4%2B6pR8G3ykqh4rpk8Hyo%3D&Expires=1656906112"
wget -c -O v1.0-trainval03_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval03_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=JQCfIXeOIy3dv0s5LnNZIvRAmrA%3D&Expires=1656906204"
wget -c -O v1.0-trainval04_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval04_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=SGen1IV7ZFwPz5BQ8YqkplCXvXk%3D&Expires=1656906246"
wget -c -O v1.0-trainval05_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval05_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=HynZB1K4AAkMhAZ%2FOVcpDTxnEPI%3D&Expires=1656906327"
wget -c -O v1.0-trainval06_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval06_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=qH52r4P4MltaDXw68HS64xrZZbg%3D&Expires=1656906361"
wget -c -O v1.0-trainval07_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval07_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=rM6gmdUjwh%2BRe1kIsQ3TibIq6Js%3D&Expires=1656913003"
wget -c -O v1.0-trainval08_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval08_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=Di988OpbFNQApXNRJyWdokpj2cM%3D&Expires=1656913042"
wget -c -O v1.0-trainval09_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval09_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=8Th2Z%2FbELaQ16Pv7A%2FjwTYVTN6k%3D&Expires=1656913078"
wget -c -O v1.0-trainval10_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval10_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=Kc%2FF685kVVJG%2FenjmWQt2kHnyKM%3D&Expires=1656913104"
Note : There may be a problem with the above script address, 因为nuscenes定期会更换下载地址,故需要采用2中提供的方法 重新粘贴下载地址
.
4. Use the script to start downloading data
bash dataset.sh
Note : If it is broken midway, just re-execute the script.
5. Verify and decompress data
5.1 Calibration
md5sum v1.0-trainval07_blobs_lidar.tgz
## 结果,运行过程比较慢,稍微等待几分钟
md5: 30672d212a2cecde92c28ee473aa76d1 v1.0-trainval07_blobs_lidar.tgz
5.2 Decompress data
Command: tar -zvxf nuscenes data.tgz [-C save file path]
tar -zvxf v1.0-trainval03_blobs.tgz