ccu, Administrators
684
edits
Changes
Jump to navigation
Jump to search
m
To find the dataset, just tip
<syntaxhighlight lang="bash">
> kubectl get pvc
</syntaxhighlight>
and you will get the information like following:
<syntaxhighlight lang="bash"TBC->pvc name: '''nuScenes dataset-kitti, capacity: 100Gi, access modes: RWO, storageclass:ceph-ssd </syntaxhighlight>'''
To access to the dataset, you can get a root shell inside the container as usual (insert the correct pod name you used below):
> kubectl exec -it user-name-pvc-access-pod /bin/bash</syntaxhighlight> Then access into the dataset like following: <syntaxhighlight lang="bash">root@user-name-pvc-access-pod:/# cd mnt/dataset-kitti/nuScenes Datasetroot@user-name-pvc-access-pod:/mnt└── /dataset-kitti# <raid/syntaxhighlight> If you want to bind your project to this global dataset, please change your '''job-script-pvc.yaml''' like following: <syntaxhighlight lang="bash">... # list of mount paths within the container which will be # bound to persistent volumes. volumeMounts: # datasets/tmpgeneral/data is where mnist.py will download the training data, unless it is # already there. This is the path where we mount the persistent volume. # Thus, for the second run of this container, the data will # not be downloaded again. - mountPath: "/mnt/dataset_kitti" # # name of the volume for this path (from the below list) name: dataset-kitti-user # login credentials to the docker registry. # for convenience, a readonly credential is provided as a secret in each namespace. imagePullSecrets: - name: registry-ro-login # containers will never restart restartPolicy: Never volumes: # User-defined name of the persistent volume within this configuration. # This can be different from the name of the PVC. - name: dataset-kitti-user persistentVolumeClaim: # name of the PVC this volume binds to claimName: dataset-kitti...nuscenes
TBC->'''nuScenes dataset'''
→List of datasets in global storage
<syntaxhighlight lang="bash">
# KITTI Dataset
└── /mntraid/dataset_kittidatasets/general/kitti
├── training <-- 7481 train data
| ├── image_2 <-- for visualization
<syntaxhighlight lang="bash">
</syntaxhighlight>
