App has been syncing for a long time after multiple edits, many image attachments

Looks like they stopped. Thanks.
And your image size looks fine. The server is not reporting any other problem. Hmm

So the client is hanging up and retrying repeatedly? Nothing unusual to report about internet speeds here, they seem typical. Are there any client side logs I can send? I went looking for some but couldn’t seem to find them.

Yes. What I can know at the moment is that the connection hangs up while syncing.
So I would like to know if it works: Changing batch size of sync.
I’ll post the config for that.

Ok awesome! Apologies but it is late here, I will test the config in the morning and report back if that is OK.

Sure! It’s also late in Japan here. See you tomorrow!

Please add sync options in ~/.config/inkdrop/config.cson like so:

"*":
  core:
    db:
      sync:
        options:
          push:
            batch_size: 2
            batches_limit: 2
          pull:
            batch_size: 20
            batches_limit: 2

And launch the app.
It will send only 2 documents per request so the connection should not hang due to timeout.
Since you have many notes and images, it will take for a while until the sync finishes.
I’ll check the server log tomorrow morning if the same error happens.

Thank you for your cooperation!

Ok, will test and report! Are there any other settings you would like tested if these don’t work as expected?

Also, any limit you would like on the time I let it try and sync to avoid server disruptions again?

Thank you for the help!

Not sure for now, but if a particular file/note causes this issue, it will be hard.
You will have to remove local database and have to add notes slowly again while checking the sync is working fine.

I will be working from 9:00 to 18:00 (JST) :slight_smile:

Ok thanks for the guidance! Sleep well, I will kick off the sync again in the morning and try to step-test the notes if the issue still happens with the new settings. We are close in time-zones so should be able to give feedback during better hours :slight_smile:

Got it, thank you! Good night~

Ok, I have the sync settings in place as described and have started the sync process now, please let me know how it looks at your end, or if I need to turn it off again!

Ok, I think it is a weird note somewhere? I have some testing and observations:

  • I logged out, deleted all local data, logged back in.
  • My sync was up to date with around 60% of the notes I added yesterday.
  • I deleted all notes, then imported a backup made yesterday before the issue started.
  • I noticed after this process, some notes were missing from the backup.
  • However, all notes are present in the markdown export created by “Export -> All notes”.

So I wonder if there is content in one of the notes that is causing the sync or encryption to have issues?

Hi. I found that the same error occurs again. But it stopped happening since 20 minutes ago.

Yeah I suspect that some notes causing the problem.
You can run the app from terminal so you can see error logs from the main process. It might be helpful.

1 Like

I’m rebuilding my notes using the markdown importer at the moment - after this is complete I will see if the process happens again.

Originally I was copy-pasting from another web-based notes app, I wonder if some unexpected characters or tags were introduced that caused a problem?

Thanks and sorry for the trouble!
I guess so but I haven’t ever encountered such problem.
The connection hangs up if it took over 10 minutes.
I need to know why a particular note causes timeout…
I guess it is just taking too long time to encrypt because there is no exceptions thrown.

Now you have 51 notes and the sync looks working fine.

I seem to have just triggered it again while re-creating notes? I was adding the images back into a markdown import and now the syncing is taking longer.

Yep, the error occurred again!

Do you get any errors in console?