NextCloud 11 and WebDAV

dz00te · April 4, 2017, 12:08pm

i’m not a nextcloud user so forgive my errors:
i’ve installed ns7 on arubaclud,
configured letsencrypt
installed openldap and created user
installed nextlcoud 11.0.2

i need only webdav to test the new backup
but, while i can connect to nextcloud via web browser, i can’t connect via app(andorid,linux,win on https://my.domain.org/nextcloud) or webdav (tested with cadaver and nautilius on https://my.domain.org/nextcloud/remote.php/dav/files/USERNAME/ or https://my.domain.org/nextcloud/remote.php/webdav/ )

did i missing something?

tnx

davidep · April 4, 2017, 12:41pm

Our architecture changed with nextcloud 11. Now it runs under a php-fpm instance with an apache ProxyPass in front of it. The reason is NC11 wants PHP 5.6 but the upstream Apache instance has mod_php 5.4.

Excluding connection issues, let’s see Apache log files, and application log files.

Edit:

I can reproduce the problem. It is a bug!

davidep · April 4, 2017, 3:22pm

I removed the update to NextCloud 11 from the nethserver-updates repository, released today on 2017-04-04 07:19 UTC.

The mirrors are excluded until tomorrow morning (approx 2017-04-05 09:00 UTC) to avoid metadata conflicts.

Before proceeding with the release of NextCloud 11 this bug must be fixed, otherwise any existing WebDAV client cannot connect to the NextCloud instance any more.

davidep · April 4, 2017, 4:00pm

Bug filed

I guess we must fix the ProxyPass / URL rewriting configuration for WebDAV calls from Apache to php-fpm.

https://docs.nextcloud.com/server/11/admin_manual/installation/source_installation.html?highlight=fpm#php-fpm-tips-label

any hint is welcome! /cc @dev_team

dz00te · April 5, 2017, 7:17am

@davidep see comment on github

davidep · April 5, 2017, 9:01am

Thank you for the hint! It seems to fix the problem!

I’ve uploaded a package to nethserver-testing. I’ve tested it with the Windows client.

 yum --enablerepo=nethserver-testing update nextcloud

Could you give it a try, too? /cc @quality_team

dz00te · April 5, 2017, 9:58am

it seems to work for me too.
Connection tested with

cadaver
nautilius (also if i can’t copy files with space in the name, maybe a limitation? i’ll investigate)
app from linux
ns7 backup + webdav

anyway since i’m not a nextcloud user i would like to wait tests from someone who better know nextcloud
tnx!

dz00te · April 5, 2017, 10:29am

it seems a known problem…

github.com/nextcloud/server

Unable to create or interact with files containing spaces.

opened 04:29PM - 22 Oct 16 UTC

closed 10:10AM - 07 Aug 17 UTC

couling

bug needs info feature: filesystem

I have a fresh installation of Nextcloud 10.0.1. In the web-ui I can't create a…ny files / folders with spaces in the name. Neither can I rename or delete any existing files or folders with a space. The existing files with spaces were added on the command line. I'm running Ubuntu 16.04. Apache 2.4, php 7.4 (through php-fpm). I've had this problem both with mysql and postgresql as the database. To reproduce this: - Get a fresh copy of ubuntu - Install through apt apache2, php, php-fpm, mysql-server - Install nextcloud 10.0.1 - From the web UI create a new folder and use the default name "New Folder". The result is no folder is created and an error is left in the log. The error from the logs is: ``` "Message":"Requested uri (\/cloud\/remote.php\/webdav\/New%20folder) is out of base uri (\/remote.php\/webdav\/)","Exception":"LogicException","Code":0,"Trace":"#0 \/srv\/apache\/www.example.com\/content\/cloud\/3rdparty\/sabre\/dav\/lib\/DAV\/Server.php(1225): Sabre\\HTTP\\Request->getPath()\n#1 \/srv\/apache\/www.example.com\/content\/cloud\/3rdparty\/sabre\/dav\/lib\/DAV\/Server.php(454): Sabre\\DAV\\Server->checkPreconditions(Object(Sabre\\HTTP\\Request), Object(Sabre\\HTTP\\Response))\n#2 \/srv\/apache\/www.example.com\/content\/cloud\/3rdparty\/sabre\/dav\/lib\/DAV\/Server.php(248): Sabre\\DAV\\Server->invokeMethod(Object(Sabre\\HTTP\\Request), Object(Sabre\\HTTP\\Response))\n#3 \/srv\/apache\/www.example.com\/content\/cloud\/apps\/dav\/appinfo\/v1\/webdav.php(60): Sabre\\DAV\\Server->exec()\n#4 \/srv\/apache\/www.example.com\/content\/cloud\/remote.php(165): require_once('\/srv\/apache\/www...')\n#5 {main}","File":"\/srv\/apache\/www.example.com\/content\/cloud\/3rdparty\/sabre\/http\/lib\/Request.php","Line":214,"User":"philip"} ``` For PHP I have installed: ``` php-common 1:35ubuntu6 php-curl 1:7.0+35ubuntu6 php-fpm 1:7.0+35ubuntu6 php-gd 1:7.0+35ubuntu6 php-mbstring 1:7.0+35ubuntu6 php-mysql 1:7.0+35ubuntu6 php-zip 1:7.0+35ubuntu6 php5-common 5.6.17+dfsg-3ubuntu1 php5-curl 5.6.17+dfsg-3ubuntu1 php5-gd 5.6.17+dfsg-3ubuntu1 php5-mysql 5.6.17+dfsg-3ubuntu1 php7.0-cli 7.0.8-0ubuntu0.16.04.3 php7.0-common 7.0.8-0ubuntu0.16.04.3 php7.0-curl 7.0.8-0ubuntu0.16.04.3 php7.0-fpm 7.0.8-0ubuntu0.16.04.3 php7.0-gd 7.0.8-0ubuntu0.16.04.3 php7.0-json 7.0.8-0ubuntu0.16.04.3 php7.0-mbstring 7.0.8-0ubuntu0.16.04.3 php7.0-mysql 7.0.8-0ubuntu0.16.04.3 php7.0-opcache 7.0.8-0ubuntu0.16.04.3 php7.0-readline 7.0.8-0ubuntu0.16.04.3 php7.0-xml 7.0.8-0ubuntu0.16.04.3 php7.0-zip 7.0.8-0ubuntu0.16.04.3 ```

so, although I’m not sure what I’m doing
i’ve disabled the proxypassmatch line and added to

<Directory "/usr/share/nextcloud">
...
<FilesMatch \.php$>
         SetHandler "proxy:fcgi://127.0.0.1:9000"
</FilesMatch>
</Directory>

now seem to work with files containing spaces…

but… i’ve found that mounting webdav on window
https://docs.nextcloud.com/server/11/user_manual/files/access_webdav.html#accessing-files-using-microsoft-windows
don’t allow me to copy files… i can delete file, create and remove dir…
this problem is present also with proxypass configuration… any idea?
tnx!

edit: on windows using an util like netdrive seems to work well
note that also if the manual says to connect using:
https://example.com/nextcloud/remote.php/dav/files/USERNAME/
i’ve made my test using:
https://example.com/nextcloud/remote.php/webdav/
because it’s only way for me to connect (on win/nautilius/nackupNs7)

dz00te · April 5, 2017, 11:55am

ok, this one seems a nc11 bug… if someone is interested, i have tested the patch and works well, and should be included in the next week relase (11.0.3)
more info:

github.com/nextcloud/server

Sabre\DAV\Exception\NotFound: HTTP/1.1 404 - when uploading files via WEBDAV

opened 07:05PM - 29 Dec 16 UTC

closed 08:27AM - 08 Mar 17 UTC

navimike

needs info feature: dav

### Steps to reproduce 1. Install NC on shared host (all-inkl with SSL Lets encrypt in my case) using mySQL 2. Create user 3. OS X - Finder - Cmd+K: Connect to https://host.url/remote.php/webdav using user credentials 4. Try to upload a file ### Expected behaviour File should be uploaded. ### Actual behaviour File with 0 kB is created, but Finder shows error message (German) "Der Finder konnte diesen Vorgang nicht abschließen, da einige Daten in „coupon2.pdf“ nicht gelesen oder geschrieben werden konnten. (Fehler: -36)" Error:-36 **Upload with Cyberduck via WebDAV (HTTPS) works.** ### Server configuration **Operating system**: Linux 3.13.0-105-generic #152-Ubuntu SMP Fri Dec 2 15:37:11 UTC 2016 x86_64 **Web server:** Apache **Database:** MySQL Server-Version: 5.6.33-nmm1-log - (Ubuntu) **PHP version:** 7.0.10-NMM1 as CGI/FPM **Nextcloud version:** (see Nextcloud admin page) 11.0.0 **Updated from an older Nextcloud/ownCloud or fresh install:** 10.0.2 / same behavior for fresh install **Where did you install Nextcloud from:** tar file from nextcloud.com **Signing status:** <details> <summary>Signing status</summary> No errors have been found. </details> **List of activated apps:** <details> <summary>App list</summary> Contacts Calendar </details> **The content of config/config.php:** <details> <summary>Config report</summary> <?php $CONFIG = array ( 'instanceid' => '[REMOVED]', 'passwordsalt' => '[REMOVED]', 'secret' => '[REMOVED]', 'trusted_domains' => array ( 0 => '[REMOVED].[REMOVED].[REMOVED]', ), 'datadirectory' => '/www/htdocs/[REMOVED]/[REMOVED]_data', 'tempdirectory' => '/www/htdocs/[REMOVED]/[REMOVED]_temp', 'overwrite.cli.url' => 'https://[REMOVED].[REMOVED].it', 'dbtype' => 'mysql', 'version' => '11.0.0.10', 'dbname' => '[REMOVED]', 'dbhost' => 'localhost', 'dbport' => '', 'dbtableprefix' => 'oc_', 'dbuser' => '[REMOVED]', 'dbpassword' => '[REMOVED]', 'logtimezone' => 'UTC', 'installed' => true, 'mail_from_address' => '[REMOVED]', 'mail_smtpmode' => 'php', 'mail_domain' => '[REMOVED].[REMOVED]', 'loglevel' => 0, 'mail_smtpsecure' => 'ssl', 'theme' => '', 'maintenance' => false, ); </details> **Are you using external storage, if yes which one:** No. **Are you using encryption:** yes, but same behavior without encryption (tested with new installation) **Are you using an external user-backend, if yes which one:** No. ### Client configuration **Browser:** Finder (Browser upload works) **Operating system:** Mac OS X 10.12.2 ### Logs #### Nextcloud log (data/nextcloud.log) <details> <summary>Nextcloud log</summary> {"reqId":"[REMOVED]","remoteAddr":"[REMOVED]","app":"webdav","message":"Exception: {\"Message\":\"HTTP\\\/1.1 404 File with name coupon2.pdf could not be located\",\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\NotFound\",\"Code\":0,\"Trace\":\"#0 \\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(939): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\ObjectTree->getNodeForPath('coupon2.pdf')\\n#1 \\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(336): Sabre\\\\DAV\\\\Server->getPropertiesForPath('coupon2.pdf', Array, 0)\\n#2 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPropFind(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#3 \\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#4 \\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:PROPFIND', Array)\\n#5 \\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#6 \\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(60): Sabre\\\\DAV\\\\Server->exec()\\n#7 \\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/remote.php(165): require_once('\\\/www\\\/htdocs\\\/w01...')\\n#8 {main}\",\"File\":\"\\\/www\\\/htdocs\\\/[REMOVED]\\\/[REMOVED]\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/ObjectTree.php\",\"Line\":173,\"User\":\"Michael\"}","level":0,"time":"2016-12-29T18:34:33+00:00","method":"PROPFIND","url":"\/remote.php\/webdav\/coupon2.pdf","user":"Michael","version":"11.0.0.10"} </details>

davidep · April 5, 2017, 12:25pm

IIUC the only fix to apply is for whitespace (FileMatch+SetHandler)?

dz00te · April 5, 2017, 1:23pm

yes if you think it’s a valid patch… for me works.
tnx

edit:
and permission on /usr/share/nextcloud/.user.ini

davidep · April 6, 2017, 8:47am

Thank you very much, @dz00te! I’ve just uploaded a new package in nethserver-testing with the suggested patches:

yum --enablerepo=nethserver-testing update nextcloud-11.0.2-1.3.gbcd069aa.ns7.noarch

After installing it:

systemctl restart httpd

alefattorini · April 6, 2017, 1:17pm

Good catch folks @dz00te @davidep

davidep · April 7, 2017, 7:57am

The bugfix has been just released and will be soon available from all mirrors!

special acknowledgements to @dz00te, for driving me to the solution!

davidep · April 9, 2017, 7:57am

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.