Problem with calendar future events (over 9 months ahead)



  • Hi guys,

    my girlfriend and I encounter some misterious problems using thunderbird+lightning,
    2 android phones with davdroid1.3.6ose and gmx caldav services.

    While most of the time my girlfriend uses 3 calendars at gmx and inputs her events via the pc, thunderbird/lightning. She has a lot of events in her calendars until next spring 2018. Lightning syncronizes well, all events can be managed on a later time as well. When it comes up to syncronisation with the mobilephones and DAVdroid we recognized that actual all events of 2 calendars past September are not available on the phone ,the third quits mid october. When we create a new event on the phone past September all 3 calendars get syncronized and the events are available at the pc.

    Hope you get it. Any ideas/suggestions?

    Kind regards and thanks for this nice piece of software.

    herz_AG


  • developer

    The default setting for past events is 90 days into the past, which makes 25 Jan - 90 days ~ 25 Oct, which meets your description of mid-October.

    If you want older events to be synchronized, please set your DAVdroid account settings ("past event time limit") accordingly.



  • Thanks for your answer.

    I'm sorry for not making it clear enough.
    It's not about older events, but of upcoming/future events:
    The events were scheduled at the PC using lightning about mid-january 2017 until march 2018,
    three out of four calendars on both phones stop at the end of september 2017, the last in mid october 2017. Most events past september 2017 are not visible on the phone in Google calendar (Google calendar not syncronized with google!)

    Kind regards,
    herz_AG


  • developer

    I see. Can you provide detailed steps to reproduce, i.e. which events I have to create in GMX so that I can reproduce the problem? I guess it's a GMX problem but I have to reproduce the problem to be sure.



  • @rfc2822 thanks for your reply.

    I just did the following:
    We have three shared calendars A, B, C. I scheduled an event for all three calendars for Nov, 16th 20:00h, 1hour, labeled test, any place, no special tags (standard Lightning event).
    Manual/Auto syncronisation Lightning ->GMX.
    On the phone: start CALDAV manual syncro all three calendars, start Google Calendar, menu do a manual update.
    NOT even one event on the 16th of Nov. (No change when I use different times, e.g. 8am, 2pm, 8pm, all day, more days)

    Now I schedule three events on the phone, e.g. Nov, 17th, A:8am, B:all day, C:2days.
    start CALDAV, syncronize all 3 calendars, go back to Google Calendar...
    all three events disappeared!!!
    Syncro with Lightning: no event arrived on the PC!

    Very, very strange....

    kind regards,
    herz_AG


  • developer

    @herz_AG I have reproduce the problem and can confirm that this is a server bug. When creating an event on 4 Nov 2017, the event is returned correctly by REPORT with <CAL:time-range start="20161107T162122Z" />:

    [HttpClient$1] --> REPORT https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/ http/1.1
    [HttpClient$1] Content-Type: application/xml; charset=utf-8
    [HttpClient$1] Content-Length: 328
    [HttpClient$1] Depth: 1
    [HttpClient$1] 
    [HttpClient$1] <?xml version='1.0' encoding='UTF-8' ?><CAL:calendar-query xmlns="DAV:" xmlns:CAL="urn:ietf:params:xml:ns:caldav"><prop><getetag /></prop><CAL:filter><CAL:comp-filter name="VCALENDAR"><CAL:comp-filter name="VEVENT"><CAL:time-range start="20161107T162122Z" /></CAL:comp-filter></CAL:comp-filter></CAL:filter></CAL:calendar-query>
    [HttpClient$1] --> END REPORT (328-byte body)
    02-05 16:21:22.346 16812-7591/at.bitfire.davdroid:sync D/davdroid.cert4android: [cert4android.CustomCertManager$CustomHostnameVerifier] Verifying certificate for kalender.gmx.net
    02-05 16:21:22.346 16812-7591/at.bitfire.davdroid:sync D/davdroid.dav4android: [dav4android.BasicDigestAuthHandler] Adding Basic authorization header for https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/
    [HttpClient$1] <-- 207 Multi-Status https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/ (255ms)
    [HttpClient$1] Date: Sun, 05 Feb 2017 15:24:56 GMT
    [HttpClient$1] Server: Apache
    [HttpClient$1] Vary: Accept-Encoding
    [HttpClient$1] Connection: close
    [HttpClient$1] Content-Type: text/xml;charset=UTF-8
    [HttpClient$1] 
    [HttpClient$1] <?xml version="1.0" encoding="UTF-8" standalone="no"?><D:multistatus xmlns:D="DAV:"><D:response><D:href>/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics</D:href><D:propstat><D:prop><D:getetag>"EW59bRfsEgMWpbRPlzXQg9mUfPI="</D:getetag></D:prop><D:status>HTTP/1.1 200 OK</D:status></D:propstat></D:response></D:multistatus>
    [HttpClient$1] <-- END HTTP (417-byte body)
    02-05 16:21:22.556 16812-7591/at.bitfire.davdroid:sync D/davdroid.dav4android: [dav4android.DavResource] Received <response> for https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics
                                                                                   	PARAMETER #1 = [getetag(DAV:): GetETag(eTag=EW59bRfsEgMWpbRPlzXQg9mUfPI=)]
    [syncadapter.CalendarSyncManager] Found remote VEVENT: 80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics
    [syncadapter.SyncManager] Comparing local/remote entries
    [syncadapter.SyncManager] New resources have been found on the server: 80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics
    [syncadapter.SyncManager] Downloading remote entries
    [syncadapter.CalendarSyncManager] Downloading 1 events (20 at once)
    [syncadapter.CalendarSyncManager] Downloading https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics
    [HttpClient$1] --> GET https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics http/1.1
    [HttpClient$1] Accept: text/calendar
    [HttpClient$1] Accept-Encoding: identity
    [HttpClient$1] --> END GET
    02-05 16:21:22.641 16812-7591/at.bitfire.davdroid:sync D/davdroid.cert4android: [cert4android.CustomCertManager$CustomHostnameVerifier] Verifying certificate for kalender.gmx.net
    02-05 16:21:22.641 16812-7591/at.bitfire.davdroid:sync D/davdroid.dav4android: [dav4android.BasicDigestAuthHandler] Adding Basic authorization header for https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics
    [HttpClient$1] <-- 200 OK https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics (208ms)
    [HttpClient$1] Date: Sun, 05 Feb 2017 15:24:56 GMT
    [HttpClient$1] Server: Apache
    [HttpClient$1] Last-Modified: Sun, 05 Feb 2017 15:24:42 GMT
    [HttpClient$1] ETag: "EW59bRfsEgMWpbRPlzXQg9mUfPI="
    [HttpClient$1] Content-Length: 2208
    [HttpClient$1] Connection: close
    [HttpClient$1] Content-Type: text/calendar;charset=UTF-8
    [HttpClient$1] 
    [HttpClient$1] BEGIN:VCALENDAR
                                                                       PRODID:-//1&1 Mail & Media GmbH/GMX Kalender Server 3.10.0//NONSGML//DE
                                                                       VERSION:2.0
                                                                       CALSCALE:GREGORIAN
                                                                       BEGIN:VTIMEZONE
                                                                       TZID:CET
                                                                       BEGIN:DAYLIGHT
                                                                       DTSTART:19160501T230000
                                                                       TZOFFSETFROM:+0100
                                                                       TZOFFSETTO:+0200
                                                                       RDATE:19160501T230000
                                                                       RDATE:19170416T020000
                                                                       RDATE:19880327T020000
                                                                       RDATE:19940327T020000
                                                                       RDATE:19890326T020000
                                                                       RDATE:19950326T020000
                                                                       RDATE:19840325T020000
                                                                       RDATE:19900325T020000
                                                                       RDATE:19830327T020000
                                                                       RDATE:19430329T020000
                                                                       RDATE:19820328T020000
                                                                       RDATE:19850331T020000
                                                                       RDATE:19910331T020000
                                                                       RDATE:19960331T020000
                                                                       RDATE:19810329T020000
                                                                       RDATE:19860330T020000
                                                                       RDATE:19970330T020000
                                                                       RDATE:19870329T020000
                                                                       RDATE:19920329T020000
                                                                       RDATE:19930328T020000
                                                                       RDATE:19400401T020000
                                                                       RDATE:19790401T020000
                                                                       RDATE:19440403T020000
                                                                       RDATE:19780402T020000
                                                                       RDATE:19450402T020000
                                                                       RDATE:19770403T020000
                                                                       RDATE:19800406T020000
                                                                       RDATE:19180415T020000
                                                                       END:DAYLIGHT
                                                                       BEGIN:STANDARD
                                                                       DTSTART:19161001T010000
                                                                       TZOFFSETFROM:+0200
                                                                       TZOFFSETTO:+0100
                                                                       RDATE:19180916T030000
                                                                       RDATE:19170917T030000
                                                                       RDATE:19450916T020000
                                                                       RDATE:19790930T030000
                                                                       RDATE:19850929T030000
                                                                       RDATE:19910929T030000
                                                                       RDATE:19860928T030000
                                                                       RDATE:19800928T030000
                                                                       RDATE:19840930T030000
                                                                       RDATE:19900930T030000
                                                                       RDATE:19820926T030000
                                                                       RDATE:19880925T030000
                                                                       RDATE:19940925T030000
                                                                       RDATE:19810927T030000
                                                                       RDATE:19890924T030000
                                                                       RDATE:19950924T030000
                                                                       RDATE:19870927T030000
                                                                       RDATE:19920927T030000
                                                                       RDATE:19961027T030000
                                                                       RDATE:19770925T030000
                                                                       RDATE:19830925T030000
                                                                       RDATE:19930926T030000
                                                                       RDATE:19971026T030000
                                                                       RDATE:19431004T030000
                                                                       RDATE:19161001T010000
                                                                       RDATE:19421102T030000
                                                                       RDATE:19441002T030000
                                                                       RDATE:19781001T030000
                                                                       END:STANDARD
                                                                       BEGIN:DAYLIGHT
                                                                       TZOFFSETFROM:+0100
                                                                       TZOFFSETTO:+0200
                                                                       RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=-1SU
                                                                       DTSTART:19970330T020000
                                                                       END:DAYLIGHT
                                                                       BEGIN:STANDARD
                                                                       TZOFFSETFROM:+0200
                                                                       TZOFFSETTO:+0100
                                                                       RRULE:FREQ=YEARLY;BYMONTH=10;BYDAY=-1SU
                                                                       DTSTART:19971026T030000
                                                                       END:STANDARD
                                                                       END:VTIMEZONE
                                                                       BEGIN:VEVENT
                                                                       DTSTAMP:20170205T152442Z
                                                                       DTEND;TZID=CET:20171104T063000
                                                                       DTSTART;TZID=CET:20171104T053000
                                                                       SUMMARY:nov
                                                                       DESCRIPTION:
                                                                       LOCATION:
                                                                       UID:80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net
                                                                       BEGIN:VALARM
                                                                       ACTION:X-EMAIL
                                                                       TRIGGER:-PT30M
                                                                       DESCRIPTION:
                                                                       END:VALARM
                                                                       END:VEVENT
                                                                       END:VCALENDAR
    [HttpClient$1] <-- END HTTP (2208-byte body)
    

    When the same event is moved to 8 Nov 2017, it's not returned anymore:

    [syncadapter.SyncAdapterService$SyncAdapter] Sync for com.android.calendar has been initiated.
                                                                       	PARAMETER #1 = ignore_settings
                                                                       	PARAMETER #2 = sync_priority
                                                                       	PARAMETER #3 = force
                                                                       	PARAMETER #4 = ignore_backoff
    [AccountSettings] Account davdroidapp@gmx.at has version 5, current version: 5
    02-05 16:22:07.346 16812-8282/at.bitfire.davdroid:sync D/dalvikvm: GC_FOR_ALLOC freed 2065K, 57% free 8175K/18648K, paused 63ms, total 63ms
    [syncadapter.CalendarsSyncAdapterService$SyncAdapter] Updating local calendar https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/ with CollectionInfo(id=9, serviceID=5, type=null, url=https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/, readOnly=false, displayName=Gaxi, description=null, color=null, timeZone=null, supportsVEVENT=true, supportsVTODO=true, selected=true, confirmed=false)
    [syncadapter.CalendarsSyncAdapterService$SyncAdapter] Synchronizing calendar #5, URL: https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/
    [AccountSettings] Account davdroidapp@gmx.at has version 5, current version: 5
    [syncadapter.SyncManager] Preparing synchronization
    [syncadapter.SyncManager] Querying capabilities
    [HttpClient$1] --> PROPFIND https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/ http/1.1
    [HttpClient$1] Content-Type: application/xml; charset=utf-8
    [HttpClient$1] Content-Length: 227
    [HttpClient$1] Depth: 0
    [HttpClient$1] 
    [HttpClient$1] <?xml version='1.0' encoding='UTF-8' ?><propfind xmlns="DAV:" xmlns:CAL="urn:ietf:params:xml:ns:caldav" xmlns:CARD="urn:ietf:params:xml:ns:carddav"><prop><n0:getctag xmlns:n0="http://calendarserver.org/ns/" /></prop></propfind>
    [HttpClient$1] --> END PROPFIND (227-byte body)
    02-05 16:22:07.476 16812-8282/at.bitfire.davdroid:sync D/davdroid.cert4android: [cert4android.CustomCertManager$CustomHostnameVerifier] Verifying certificate for kalender.gmx.net
    02-05 16:22:07.481 16812-8282/at.bitfire.davdroid:sync D/davdroid.dav4android: [dav4android.BasicDigestAuthHandler] Trying Basic auth preemptively
    02-05 16:22:07.481 16812-8282/at.bitfire.davdroid:sync D/davdroid.dav4android: [dav4android.BasicDigestAuthHandler] Adding Basic authorization header for https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/
    [HttpClient$1] <-- 207 Multi-Status https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/ (265ms)
    [HttpClient$1] Date: Sun, 05 Feb 2017 15:25:41 GMT
    [HttpClient$1] Server: Apache
    [HttpClient$1] Vary: Accept-Encoding
    [HttpClient$1] Connection: close
    [HttpClient$1] Content-Type: text/xml;charset=UTF-8
    [HttpClient$1] 
    [HttpClient$1] <?xml version="1.0" encoding="UTF-8" standalone="no"?><D:multistatus xmlns:D="DAV:"><D:response><D:href>/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/</D:href><D:propstat><D:prop><CS:getctag xmlns:CS="http://calendarserver.org/ns/">KfEi8u/+oeMjmu7RLJRNOq+QPGo=</CS:getctag></D:prop><D:status>HTTP/1.1 200 OK</D:status></D:propstat></D:response></D:multistatus>
    [HttpClient$1] <-- END HTTP (401-byte body)
    02-05 16:22:07.711 16812-8282/at.bitfire.davdroid:sync D/davdroid.dav4android: [dav4android.DavResource] Received <response> for https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/
                                                                                   	PARAMETER #1 = [getctag(http://calendarserver.org/ns/): GetCTag(cTag=KfEi8u/+oeMjmu7RLJRNOq+QPGo=)]
    [syncadapter.SyncManager] Processing locally deleted entries
    [syncadapter.SyncManager] Locally preparing dirty entries
    [syncadapter.SyncManager] Looking for contacts/groups without file name
    [resource.LocalCalendar] Processing deleted exceptions
    [resource.LocalCalendar] Processing dirty exceptions
    [syncadapter.SyncManager] Uploading dirty entries
    [syncadapter.SyncManager] Checking sync state
    [syncadapter.SyncManager] Manual sync, ignoring CTag
    [syncadapter.SyncManager] Listing local entries
    [syncadapter.SyncManager] Found local resource: 80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics
    [syncadapter.SyncManager] Listing remote entries
    [HttpClient$1] --> REPORT https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/ http/1.1
    [HttpClient$1] Content-Type: application/xml; charset=utf-8
    [HttpClient$1] Content-Length: 328
    [HttpClient$1] Depth: 1
    [HttpClient$1] 
    [HttpClient$1] <?xml version='1.0' encoding='UTF-8' ?><CAL:calendar-query xmlns="DAV:" xmlns:CAL="urn:ietf:params:xml:ns:caldav"><prop><getetag /></prop><CAL:filter><CAL:comp-filter name="VCALENDAR"><CAL:comp-filter name="VEVENT"><CAL:time-range start="20161107T162207Z" /></CAL:comp-filter></CAL:comp-filter></CAL:filter></CAL:calendar-query>
    [HttpClient$1] --> END REPORT (328-byte body)
    02-05 16:22:07.886 16812-8282/at.bitfire.davdroid:sync D/davdroid.cert4android: [cert4android.CustomCertManager$CustomHostnameVerifier] Verifying certificate for kalender.gmx.net
    02-05 16:22:07.891 16812-8282/at.bitfire.davdroid:sync D/davdroid.dav4android: [dav4android.BasicDigestAuthHandler] Adding Basic authorization header for https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/
    [HttpClient$1] <-- 207 Multi-Status https://kalender.gmx.net/begenda/dav/f84fbc86-4b70-427b-8ec8-22a54c48901d/81d108c8-3e97-40bb-a9a9-98b0ca021272/ (272ms)
    [HttpClient$1] Date: Sun, 05 Feb 2017 15:25:41 GMT
    [HttpClient$1] Server: Apache
    [HttpClient$1] Vary: Accept-Encoding
    [HttpClient$1] Connection: close
    [HttpClient$1] Content-Type: text/xml;charset=UTF-8
    [HttpClient$1] 
    [HttpClient$1] <?xml version="1.0" encoding="UTF-8" standalone="no"?><D:multistatus xmlns:D="DAV:"/>
    [HttpClient$1] <-- END HTTP (85-byte body)
    [syncadapter.SyncManager] Comparing local/remote entries
    [syncadapter.SyncManager] 80b7ffca-666c-49f2-95e4-4ad3056b433d.kalender.gmx.net.ics is not on server anymore, deleting
    02-05 16:22:08.101 16812-8282/at.bitfire.davdroid:sync D/davdroid.ical4android: [ical4android.BatchOperation] Committing 2 operations …
    02-05 16:22:08.101 16812-8282/at.bitfire.davdroid:sync D/davdroid.ical4android: [ical4android.BatchOperation] Running operations 0 to 1
    02-05 16:22:08.156 16812-8282/at.bitfire.davdroid:sync D/davdroid.ical4android: [ical4android.BatchOperation] … 1 record(s) affected
    [syncadapter.SyncManager] Downloading remote entries
    [syncadapter.CalendarSyncManager] Downloading 0 events (20 at once)
    [syncadapter.SyncManager] Post-processing
    [syncadapter.SyncManager] Saving sync state
    [syncadapter.SyncManager] Saving CTag=KfEi8u/+oeMjmu7RLJRNOq+QPGo=
    [syncadapter.CalendarsSyncAdapterService$SyncAdapter] Calendar sync complete
    [syncadapter.SyncAdapterService$SyncAdapter] Sync for com.android.calendar complete
    

    This is a server bug (or feature?) and not a DAVdroid problem. Please contact GMX and provide this thread as information.

    As a dirty and non-scaling workaround, you may disable past event time limit in your DAVdroid settings (leave the field empty instead of e.g. 90 days).



  • Hi @rfc2822,

    thanks for your effort. I will contact gmx technical support if there is an email address available and keep you in touch with the results.

    I can confirm that your workaround is working.

    Thanks and kind regards,
    herz_AG



  • Hi @rfc2822,

    GMX technical support contacted me, saying "please try again" :-) So I did. After a quick simple test (I enabled past event time limit again) all future events in this calendar are still visible. Lets see if this works for ALL calendars AND for events in 2020 and after ... ;-)

    You may want to check this by your own.

    Thanks to you and GMX. Kind regards,
    herz_AG


Log in to reply
 

Looks like your connection to Bitfire App Forums was lost, please wait while we try to reconnect.