Daemon fails to start if it cannot write/access download directory #877

kauffj · 2017-08-29T13:11:05Z

Steps to Reproduce:

Stop daemon
Change the permissions on the download directory to 000 (e.g. chmod 000 ~/Downloads)
Start daemon

Error Trace:

2017-09-22 18:18:58,200 INFO     lbrynet.daemon.Daemon:471: Loading databases
2017-09-22 18:18:58,205 ERROR    lbrynet.daemon.DaemonControl:100: Failed to start lbrynet-daemon
Traceback (most recent call last):
  File "site-packages/lbrynet/daemon/DaemonControl.py", line 97, in start_server_and_listen
  File "site-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
  File "site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages/lbrynet/daemon/DaemonServer.py", line 53, in start
  File "site-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
  File "site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages/lbrynet/daemon/Daemon.py", line 251, in setup
  File "site-packages/twisted/python/threadpool.py", line 246, in inContext
  File "site-packages/twisted/python/threadpool.py", line 262, in <lambda>
  File "site-packages/twisted/python/context.py", line 118, in callWithContext
  File "site-packages/twisted/python/context.py", line 81, in callWithContext
  File "site-packages/lbrynet/daemon/Daemon.py", line 473, in _setup_data_directory
OSError: [Errno 13] Permission denied: '/home/miroslav/Videos/lbry'
2017-09-22 18:18:58,210 INFO     lbrynet.daemon.DaemonServer:57: Stopping the reactor

Copied from original issue: lbryio/lbry-desktop#495

The text was updated successfully, but these errors were encountered:

setenforce0 · 2017-09-04T15:32:02Z

Can someone confirm that this is still an issue? Currently cannot reproduce

mirgee · 2017-09-22T07:20:41Z

This doesn't seem to be an issue anymore. On
{
"build": "dev",
"installation_id": "6QapiUUrkTfiks6jiQnecv8pXixxm1LncbgGB32x6nXpQ1aipjikPboVJM4UxsXruR",
"lbrynet_version": "0.16.1-4-g4a04018",
"lbryschema_version": "0.0.11rc1",
"lbryum_version": "3.1.7rc5",
"os_release": "4.10.0-35-generic",
"os_system": "Linux",
"platform": "Linux-4.10.0-35-generic-x86_64-with-Ubuntu-16.04-xenial",
"processor": "x86_64",
"python_version": "2.7.12"
}
the daemon rebuilds the file:
2017-09-22 09:15:34,572 INFO lbrynet.daemon.Daemon:1513: Already have lbry file but missing file in /home/miroslav/Videos/lbry, rebuilding it

This issue should be closed?

Makgolli · 2017-09-22T12:11:02Z

It is still an issue in version 16.0. The app tries to create the download directory specified in the settings. If there is no write permission in that directory for the current user, then the Daemon shuts down.

…

On 22 September 2017 at 08:20, Miroslav Kovar ***@***.***> wrote: This doesn't seem to be an issue anymore. On { "build": "dev", "installation_id": "6QapiUUrkTfiks6jiQnecv8pXixxm1 LncbgGB32x6nXpQ1aipjikPboVJM4UxsXruR", "lbrynet_version": "0.16.1-4-g4a04018", "lbryschema_version": "0.0.11rc1", "lbryum_version": "3.1.7rc5", "os_release": "4.10.0-35-generic", "os_system": "Linux", "platform": "Linux-4.10.0-35-generic-x86_64-with-Ubuntu-16.04-xenial", "processor": "x86_64", "python_version": "2.7.12" } the daemon rebuilds the file: 2017-09-22 09:15:34,572 INFO lbrynet.daemon.Daemon:1513: Already have lbry file but missing file in /home/miroslav/Videos/lbry, rebuilding it This issue should be closed? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#877 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AbNyIaoJFCIL8J-4qPQOt8DHG_JAvtS7ks5sk1_PgaJpZM4PF6I4> .

tzarebczan · 2017-09-22T16:08:10Z

@mirgee I think you were referencing a rebuild of a particular LBRY download that's deleted, where-as this issue pertains to the entire downloads directory. So let's say the whole directory moved or is inaccessible (shared drive that's disconnected)

tzarebczan · 2017-09-22T16:08:24Z

@alexliebowitz - were you going to take a stab at this?

mirgee · 2017-09-22T16:21:37Z

@tzarebczan The app indeed tries to recreate the whole directory; when it has no permissions (or is inaccessible) the daemon crashes:

2017-09-22 18:18:58,200 INFO     lbrynet.daemon.Daemon:471: Loading databases
2017-09-22 18:18:58,205 ERROR    lbrynet.daemon.DaemonControl:100: Failed to start lbrynet-daemon
Traceback (most recent call last):
  File "site-packages/lbrynet/daemon/DaemonControl.py", line 97, in start_server_and_listen
  File "site-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
  File "site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages/lbrynet/daemon/DaemonServer.py", line 53, in start
  File "site-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
  File "site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages/lbrynet/daemon/Daemon.py", line 251, in setup
  File "site-packages/twisted/python/threadpool.py", line 246, in inContext
  File "site-packages/twisted/python/threadpool.py", line 262, in <lambda>
  File "site-packages/twisted/python/context.py", line 118, in callWithContext
  File "site-packages/twisted/python/context.py", line 81, in callWithContext
  File "site-packages/lbrynet/daemon/Daemon.py", line 473, in _setup_data_directory
OSError: [Errno 13] Permission denied: '/home/miroslav/Videos/lbry'
2017-09-22 18:18:58,210 INFO     lbrynet.daemon.DaemonServer:57: Stopping the reactor

tzarebczan · 2018-01-17T01:19:48Z

@mirgee we can't reproduce this...were you ever able to? Closing it for now.

tzarebczan · 2018-05-02T16:54:47Z

Going to reopen, a user recently ran into this on his Mac. He had the download directory set in daemon_settings.yml

2018-04-28 15:22:52,755 INFO     lbrynet.daemon.Daemon:274: Platform: {"lbrynet_version": "0.19.1", "platform": "Darwin-17.5.0-x86_64-i386-64bit", "os_system": "Darwin", "python_version": "2.7.13", "os_release": "17.5.0", "lbryum_version": "3.2.0", "ip": "Could not determine IP", "lbryschema_version": "0.0.15", "processor": "i386", "build": "release"}
2018-04-28 15:22:52,767 INFO     lbrynet.daemon.Daemon:478: Loading databases
2018-04-28 15:22:52,772 ERROR    lbrynet.daemon.DaemonControl:113: Failed to start lbrynet-daemon
Traceback (most recent call last):
  File "site-packages/lbrynet/daemon/DaemonControl.py", line 110, in start_server_and_listen
  File "site-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
  File "site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages/lbrynet/daemon/DaemonServer.py", line 51, in start
  File "site-packages/twisted/internet/defer.py", line 1297, in _inlineCallbacks
  File "site-packages/twisted/python/failure.py", line 389, in throwExceptionIntoGenerator
  File "site-packages/lbrynet/daemon/Daemon.py", line 239, in setup
  File "site-packages/twisted/python/threadpool.py", line 246, in inContext
  File "site-packages/twisted/python/threadpool.py", line 262, in <lambda>
  File "site-packages/twisted/python/context.py", line 118, in callWithContext
  File "site-packages/twisted/python/context.py", line 81, in callWithContext
  File "site-packages/lbrynet/daemon/Daemon.py", line 480, in _setup_data_directory
OSError: [Errno 2] No such file or directory: '/Volumes/CRYP-1/Crypto-currencies/Wallets'

eukreign · 2019-01-28T19:57:05Z

@jackrobison can you add some integration tests for the blob exchange that properly handles missing directory and permission issues.

tzarebczan · 2019-03-02T03:40:56Z

This is still an issue, especially on Mac where the daemon fails to start entirely (won't even write to log) if the download directory is not available. I think the best thing to do is allow startup and just write to the default download directory for the session. It would be nice to alert the users that this changed/was unavailable...what if I unplugged my external, started LBRY, and then re-plugged it back in later - I should still be able to use it on a subsequent startup.

tzarebczan · 2019-06-28T18:47:26Z

Had a few people fall victim to this over the last couple of weeks.

eukreign · 2019-12-13T14:44:26Z

daemon starts with inaccessible download directory (also, it will try to create it if it can)

tzarebczan · 2020-04-30T15:13:28Z

A user ran into this recently so I don't think it's fixed. Can we please add a test too if we fix it?

lyoshenka · 2021-04-20T19:52:13Z

closing in favor of #3270

kauffj mentioned this issue Aug 29, 2017

Daemon fails to start if download directory moved lbryio/lbry-desktop#495

Closed

tzarebczan added the help wanted label Aug 30, 2017

kauffj added the type: bug Existing functionality is wrong or broken label Sep 19, 2017

lyoshenka changed the title ~~Daemon fails to start if download directory moved~~ Daemon fails to start if it cannot write to download directory Oct 3, 2017

lyoshenka added the hacktoberfest label Oct 3, 2017

tzarebczan removed the hacktoberfest label Nov 21, 2017

lyoshenka added needs level level: 1 No knowledge of the existing code required area: files good first issue and removed needs labels labels Jan 9, 2018

tzarebczan closed this as completed Jan 17, 2018

tzarebczan reopened this May 2, 2018

alyssaoc added the hacktoberfest Welcome to Hacktoberfest label Sep 23, 2018

eukreign assigned jackrobison Jan 28, 2019

tzarebczan added the consider soon Discuss this issue at the next planning meeting, then remove this label label Mar 2, 2019

alyssaoc added priority: medium Work needs to be done within 2-3 sprints and removed consider soon Discuss this issue at the next planning meeting, then remove this label labels Mar 4, 2019

alyssaoc unassigned jackrobison Mar 4, 2019

tzarebczan changed the title ~~Daemon fails to start if it cannot write to download directory~~ Daemon fails to start if it cannot write/access to download directory Jun 28, 2019

tzarebczan changed the title ~~Daemon fails to start if it cannot write/access to download directory~~ Daemon fails to start if it cannot write/access download directory Jun 28, 2019

tzarebczan added the consider soon Discuss this issue at the next planning meeting, then remove this label label Jun 28, 2019

mirgee mentioned this issue Sep 11, 2019

Log inaccessible downloads / wallet path, switch to default if possible #2454

Closed

lyoshenka removed the consider soon Discuss this issue at the next planning meeting, then remove this label label Sep 17, 2019

mirgee mentioned this issue Sep 21, 2019

--config argument silently falls back to defaults when the file does not exist #2027

Open

eukreign closed this as completed Dec 13, 2019

tzarebczan reopened this Apr 30, 2020

Geo25rey mentioned this issue Jun 29, 2020

Added Better Permission Checks for Configuration Directories #2988

Closed

lyoshenka mentioned this issue Apr 20, 2021

Ensure that default download directory is writable on daemon startup #3270

Open

lyoshenka closed this as completed Apr 20, 2021

ghost mentioned this issue Oct 25, 2021

Prevent daemon from starting if directories are not writable #3457

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Daemon fails to start if it cannot write/access download directory #877

Daemon fails to start if it cannot write/access download directory #877

kauffj commented Aug 29, 2017 •

edited by eukreign

setenforce0 commented Sep 4, 2017

mirgee commented Sep 22, 2017

Makgolli commented Sep 22, 2017 via email

tzarebczan commented Sep 22, 2017

tzarebczan commented Sep 22, 2017

mirgee commented Sep 22, 2017 •

edited

tzarebczan commented Jan 17, 2018

tzarebczan commented May 2, 2018

eukreign commented Jan 28, 2019

tzarebczan commented Mar 2, 2019

tzarebczan commented Jun 28, 2019

eukreign commented Dec 13, 2019

tzarebczan commented Apr 30, 2020

lyoshenka commented Apr 20, 2021

Daemon fails to start if it cannot write/access download directory #877

Daemon fails to start if it cannot write/access download directory #877

Comments

kauffj commented Aug 29, 2017 • edited by eukreign

Steps to Reproduce:

Error Trace:

setenforce0 commented Sep 4, 2017

mirgee commented Sep 22, 2017

Makgolli commented Sep 22, 2017 via email

tzarebczan commented Sep 22, 2017

tzarebczan commented Sep 22, 2017

mirgee commented Sep 22, 2017 • edited

tzarebczan commented Jan 17, 2018

tzarebczan commented May 2, 2018

eukreign commented Jan 28, 2019

tzarebczan commented Mar 2, 2019

tzarebczan commented Jun 28, 2019

eukreign commented Dec 13, 2019

tzarebczan commented Apr 30, 2020

lyoshenka commented Apr 20, 2021

kauffj commented Aug 29, 2017 •

edited by eukreign

mirgee commented Sep 22, 2017 •

edited