Failed to run ./download_dataset.py

[mohammad-h-b]

Hi,

After following all the installation steps, when running ./download_dataset.py I get this error:

Traceback (most recent call last):
File "./download_dataset.py", line 3, in
import morefusion
ModuleNotFoundError: No module named 'morefusion'

[wkentaro]

You need to run source .anaconda3/bin/activate before running any python commands.

[mohammad-h-b]

Thanks! it worked!

But now I get this error:

Traceback (most recent call last):
File "./download_dataset.py", line 7, in
morefusion.datasets.YCBVideoInstanceSegmentationDataset(split="train")
File "/home/mohammad/morefusion/morefusion/datasets/ycb_video/dataset.py", line 37, in init
self._ids = self.get_ids(sampling=sampling)
File "/home/mohammad/morefusion/morefusion/datasets/ycb_video/dataset.py", line 72, in get_ids
with open(imageset_file) as f:
FileNotFoundError: [Errno 2] No such file or directory: Path('/home/mohammad/data/ycb_video/YCB_Video_Dataset/image_sets/train.txt')

[wkentaro]

You may be missing some files:

% ls ~/data/ycb_video/YCB_Video_Dataset/image_sets 
classes.txt
keyframe.txt
train.txt
trainval.txt
val.txt

[mohammad-h-b]

Could you please provide a docker file? it seems many problems such as incompatible version of chainer, cupy, ... are because of the different CUDA version.

[mohammad-h-b]

You may be missing some files:

% ls ~/data/ycb_video/YCB_Video_Dataset/image_sets 
classes.txt
keyframe.txt
train.txt
trainval.txt
val.txt

I only have these folders. Where shoud I get YCB_Video_Dataset?

[snijders-tjm]

For me the following worked (sort of):

Open file:
~/ros_morefusion/src/morefusion/datasets/ycb_video/dataset.py

And change

    def __init__(self, split: str, sampling=1):
        assert split in ("train", "val", "trainval", "keyframe")
        self._split = split
        self._ids = self.get_ids(sampling=sampling)

        if not self.root_dir.exists():
            self.download()

To

    def __init__(self, split: str, sampling=1):

        if not self.root_dir.exists():
            self.download()
        assert split in ("train", "val", "trainval", "keyframe")
        self._split = split
        self._ids = self.get_ids(sampling=sampling)

Only problem I encounter now comes from Google drive, saying the following:

Sorry, you can't view or download this file at this time.

Too many users have viewed or downloaded this file recently. Please try accessing the file again later. If the file you are trying to access is particularly large or is shared with many people, it may take up to 24 hours to be able to view or download the file. If you still can't access a file after 24 hours, contact your domain administrator.

[mohammad-h-b]

For me the following worked (sort of):

Open file:
~/ros_morefusion/src/morefusion/datasets/ycb_video/dataset.py

And change

    def __init__(self, split: str, sampling=1):
        assert split in ("train", "val", "trainval", "keyframe")
        self._split = split
        self._ids = self.get_ids(sampling=sampling)

        if not self.root_dir.exists():
            self.download()

To

    def __init__(self, split: str, sampling=1):

        if not self.root_dir.exists():
            self.download()
        assert split in ("train", "val", "trainval", "keyframe")
        self._split = split
        self._ids = self.get_ids(sampling=sampling)

Only problem I encounter now comes from Google drive, saying the following:

Sorry, you can't view or download this file at this time.
Too many users have viewed or downloaded this file recently. Please try accessing the file again later. If the file you are trying to access is particularly large or is shared with many people, it may take up to 24 hours to be able to view or download the file. If you still can't access a file after 24 hours, contact your domain administrator.

Thanks.
By doing that, I get these errors (the error you specified and one more):

Cached Downloading: /home/mohammad/data/ycb_video/YCB_Video_Dataset.reindexed.v2.zip
Access denied with the following error:

 	Too many users have viewed or downloaded this file recently. Please
	try accessing the file again later. If the file you are trying to
	access is particularly large or is shared with many people, it may
	take up to 24 hours to be able to view or download the file. If you
	still can't access a file after 24 hours, contact your domain
	administrator. 

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1l0ki7dX1WxcmV5Tfm41FPW-yk-wKUfne 

Traceback (most recent call last):
  File "/home/mohammad/morefusion/.anaconda3/lib/python3.7/shutil.py", line 566, in move
    os.rename(src, real_dst)
FileNotFoundError: [Errno 2] No such file or directory: '/home/mohammad/.cache/gdown/tmpyp8luijk/dl' -> Path('/home/mohammad/data/ycb_video/YCB_Video_Dataset.reindexed.v2.zip')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "./download_dataset.py", line 8, in <module>
    split="trainreal"
  File "/home/mohammad/morefusion/morefusion/datasets/rgbd_pose_estimation/ycb_video/reindexed.py", line 20, in __init__
    self.download()
  File "/home/mohammad/morefusion/morefusion/datasets/rgbd_pose_estimation/ycb_video/reindexed.py", line 27, in download
    postprocess=gdown.extractall,
  File "/home/mohammad/morefusion/.anaconda3/lib/python3.7/site-packages/gdown/cached_download.py", line 125, in cached_download
    shutil.move(temp_path, path)
  File "/home/mohammad/morefusion/.anaconda3/lib/python3.7/shutil.py", line 580, in move
    copy_function(src, real_dst)
  File "/home/mohammad/morefusion/.anaconda3/lib/python3.7/shutil.py", line 266, in copy2
    copyfile(src, dst, follow_symlinks=follow_symlinks)
  File "/home/mohammad/morefusion/.anaconda3/lib/python3.7/shutil.py", line 120, in copyfile
    with open(src, 'rb') as fsrc:
FileNotFoundError: [Errno 2] No such file or directory: '/home/mohammad/.cache/gdown/tmpyp8luijk/dl'

[wkentaro]

Sorry for the download limit of Google Drive.
Can you try to download the file from the browser and below URL? You probably need to log in to your Google account.

You may still be able to access the file from the browser:

	 https://drive.google.com/uc?id=1l0ki7dX1WxcmV5Tfm41FPW-yk-wKUfne 

[xzh19980408]

你能提供一个docker文件吗？ 似乎很多问题，例如chainer版本不兼容，cupy，......是因为CUDA版本不同。
请问您跑出来了吗

[xzh19980408]

我也遇到和您一样的问题