Nuscenes full version dataset batch download

Nuscenes full version dataset batch download

Requirements: Download the full version of the Nuscenes dataset at high speed. The early adopter version of the mini version was downloaded using the built-in tool of the google browser, which is slow and easy to break.

1. Data address

Official address: https://www.nuscenes.org/nuscenes

2. Get the download link

Reference : How to get the link (path) of the file to be downloaded

Specific steps :
1) Click Asia, and then cancel the download.
insert image description here
2) Click the three-dot control button in the upper right corner of the browser, and then click Downloads.
3) On the pop-up Downloads page, press F12 to open the browser console.
4) Click the square arrow button in the upper left corner of the console, then move the mouse to the address on the left, and a link address will appear on the right.
insert image description here
5) Right-click the link and select Copy Link Address.
insert image description here

3. Make a download script

Reference :
1.ubuntu20.04 batch download NuScenes V1.0 full dataset
2.quick download method of nuScenes dataset under linux system

Select the folder to download, create a new script dataset.sh, the content is as follows, the main format is: wget -c -O [dataset name] [webpage download link].
The lidar modality part of the complete training dataset is downloaded here.

wget -c -O v1.0-trainval01_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval01_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=buHbpzZWUVrSzlvJsSXphQVZd%2B8%3D&Expires=1656905855"
wget -c -O v1.0-trainval02_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval02_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=aCeQIJg4%2B6pR8G3ykqh4rpk8Hyo%3D&Expires=1656906112"
wget -c -O v1.0-trainval03_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval03_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=JQCfIXeOIy3dv0s5LnNZIvRAmrA%3D&Expires=1656906204"
wget -c -O v1.0-trainval04_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval04_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=SGen1IV7ZFwPz5BQ8YqkplCXvXk%3D&Expires=1656906246"
wget -c -O v1.0-trainval05_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval05_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=HynZB1K4AAkMhAZ%2FOVcpDTxnEPI%3D&Expires=1656906327"
wget -c -O v1.0-trainval06_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval06_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=qH52r4P4MltaDXw68HS64xrZZbg%3D&Expires=1656906361"
wget -c -O v1.0-trainval07_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval07_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=rM6gmdUjwh%2BRe1kIsQ3TibIq6Js%3D&Expires=1656913003"
wget -c -O v1.0-trainval08_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval08_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=Di988OpbFNQApXNRJyWdokpj2cM%3D&Expires=1656913042"
wget -c -O v1.0-trainval09_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval09_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=8Th2Z%2FbELaQ16Pv7A%2FjwTYVTN6k%3D&Expires=1656913078"
wget -c -O v1.0-trainval10_blobs_lidar.tgz "https://s3.ap-southeast-1.amazonaws.com/asia.data.nuscenes.org/public/v1.0/v1.0-trainval10_blobs_lidar.tgz?AWSAccessKeyId=AKIA6RIK4RRMFUKM7AM2&Signature=Kc%2FF685kVVJG%2FenjmWQt2kHnyKM%3D&Expires=1656913104"

Note : There may be a problem with the above script address, 因为nuscenes定期会更换下载地址,故需要采用2中提供的方法 重新粘贴下载地址.

4. Use the script to start downloading data

bash dataset.sh 

Note : If it is broken midway, just re-execute the script.

5. Verify and decompress data

5.1 Calibration

md5sum v1.0-trainval07_blobs_lidar.tgz
## 结果,运行过程比较慢,稍微等待几分钟
md5: 30672d212a2cecde92c28ee473aa76d1  v1.0-trainval07_blobs_lidar.tgz

5.2 Decompress data

Command: tar -zvxf nuscenes data.tgz [-C save file path]

tar -zvxf v1.0-trainval03_blobs.tgz

Guess you like

Origin blog.csdn.net/weixin_36354875/article/details/125618928