Page 13 of 26

Re: Introducing TripManager

Posted: Fri Jul 11, 2025 6:12 am
by FrankB
jfheath wrote: Fri Jul 11, 2025 12:45 am We hit a very big snag in creating the .trip file. And Frank and I had a few video chats about it. TripManager for the XT2 very nearly didn't happen.
Without an XT2 himself, I worked on finding out why and eventually hit on a solution. Frank could do nothing at this stage except add sections of code that made it easier for me to try things out.
Haha. Brings back good memories John. You could call it "The making of".
You know I'm very grateful that you took the time to help out. Just want to repeat that here. It should be noted that not only for getting TripManager to work for the XT2 your help was indispensable. It all started with 'Setting Trips to saved' to avoid the RUT. Then there was the idea of resetting the <SubClass> to prevent renaming Via/Shaping points. If I think hard enough there will be more examples.
jfheath wrote: Fri Jul 11, 2025 12:45 am while it may be possible if the entire Garmin codes could be understood
I like solving puzzles, but this one has too many uknown variables.

Re: Introducing TripManager

Posted: Fri Jul 11, 2025 1:13 pm
by Gerard
I cant contribute to this,

but know that i love reading the discussion.

Re: Introducing TripManager

Posted: Fri Jul 11, 2025 3:34 pm
by jfheath
Wow Frank - thank you. I say that I 'hit on a solution'. "Hit" is probably not the right term. What is the word for water swirling around a plughole before it eventually descends. Never mind. You get the general idea !!

And before I get all swelled up. It was a small piece in a very big jigsaw. It just needed to be found.

Re: Introducing TripManager

Posted: Fri Jul 11, 2025 7:14 pm
by smfollen
I’m a little behind on this thread. I’m mostly going to try to respond to proofresistent’s 3 questions post, adding a little perspective.

First a quick clarification.
FrankB wrote:
You may find it interesting to know that we (@smfollen and I) are working on version V1.5 that will have the option to do the compare automatically.
In the interest of giving credit where it is due, it is more like I gave Frank a couple of rough ideas and he turned it into more great features in his very useful Trip Manager.

@proofresistant regarding
“@Garmin: Thank you for the fact that so many people spend days and nights dealing with issues of poor or faulty functionality.”
And
“That's actually the only big thing I expect from the XT2. A nice display that allows me to follow my planned route”
I agree with you entirely. The reason I own an XT2 is to be able to plan and follow a route. Some of the other navigation related features are nice to have, IF they work properly and do not interfere with the primary route planning and following functions. For me additional features like phone calls and music are unnecessary complications. My phone does all that already. Other users may have differing priorities of course and Garmin wants to build what sells.

As I see it, some of the frustrations with XT[2} route planning and navigation should be owned by, and corrected by Garmin, but other frustrations are due to the nature of navigation and the state of the technology.

If there were only one road between points A and B, it would all very simple. Typically, there are several ways to get there. Before GPS and digital navigation, we might have asked 2 or 3 people how to get from A to B and receives 2 or 3 different sets of directions. We were never sure which, if any, of those were correct until we tried them.

In the digital world, 2 or 3 different devices or route planners might give us 2 or 3 different routes, due to differing maps, route preference setting, routing algorithms, and avoidance settings, but we can, at least, be confident they will all get us to point B.

However, I think It is reasonable to expect consistent results from a single vendor’s (e.g. Garmin's) related products when they are configured similarly and using the same map.
1st question:
If GPX routes are sent to the XT2 as a trip via "Transfer to device", why do the individual shaping points have the attribute "Shaping point" instead of "Shaping point XT2"
mLocations.LCTN (xyz).mAttr = "Shaping point"
vs
mLocations.LCTN (xyz).mAttr = "Shaping point XT2"
And, does this have any effect at all?
In the original gpx standard, which is publicly published, routes were made up of route points. Garmin subsequently publicly extended that standard to define two types of route points – via and shaping. The difference was important during navigation, but both types were identical in terms of route calculation. Route points were, and still are, user defined points which are inputs to route calculation.

Somewhere along the way (with the XTs maybe?) some of Garmin’s software began to make slight changes to shaping point names and locations – that is to make small changes user input - without the user’s knowledge or consent They also began to produce differing routes depending on whether a point was via or shaping. The Tread app took this much further, making dramatic changes to the user’s planned routes in some cases. viewtopic.php?t=3007
That is one of the reasons I have eliminated Tread entirely from my devices and process.

As John and Frank have already responded, the second type of shaping point, which Garmin apparently did not add publicly and has not explained, is somehow related to this behavior. I specifically asked Garmin support about this. They told me that point type definitions have evolved but they declined to provide any definitions or describe the expected behavior. They did indicate that they hope to address the above linked Tread issue sometime in 2025.
2nd question:
You can "clean up" the route with "Post process"
This centers points, which is good.
But, the basis for the points is the OSM map, which differs from the Garmin City Navigator map and therefore it is not more accurate?
I would also be interested to know how far points can be away from the roads before Garmin can no longer calculate with them.
I'm asking because I still haven't found out when and why Garmin sometimes refuses to work…
I don’t know how to respond to the general “refuses to work”. I don’t think there is a single answer to how far points can be away from the roads. In my experience, route calculations just take you to the specified point. If specified points are not placed carefully, they may be just a short distance from the intended road but may be in a field or forest, on the wrong side of a highway, or on the wrong road. The software can only take what the user specified. It has no way to know what was intended.
For myself, I address this by keeping the map in sync between Basecamp and the XT2. I check each route point of each route in Basecamp at maximum zoom level and correct any misplaced points before sending the route to the device. Yes it takes a little time, but not that much. I find it to be much better than being surprised during a ride and trying to fix the route on the side of the road.
I think Frank’s intention with the optional post process route cleanup is an attempt to help those users who don’t check carefully. I would agree that the maps may be different and could be less accurate. It is the best Trip Manager can do. @FrankB Please correct me if I’ve got this wrong.
Then at the moment my last 3rd question or better said, search for a possibility.
I would like to transfer routes to the Garmin as trips so that the XT2 no longer calculates them, even when importing them. It simply takes too many minutes.
Is it conceivable that at some point in the future, calculated GPX routes, 1:1 of the existing calculation, can also be transferred to the XT2 as a trip?
It is a mystery to me, by the way, on the basis of which attributes the XT2 recognizes that the externally used maps or routing restrictions deviate from the device's internal map
I think of routes as being either calculated or uncalculated, which Trip Manager calls a stripped route. A gpx file containing either can be sent to the XT2. If uncalculated, the XT2 seems to always calculate immediately on import. If a calculated route is imported, it will not be recalculated if, I believe, it Is based on the same map, the same vehicle profile (motorcycle), and has not had avoidances changed.

I’m surprised it takes minutes to calculate. It is normally quick for me. Maybe the Tread app and syncing slows things down? Or you have a large number of route points?

There is danger in not re-calculating the route on the device. The imported route may look fine initially, but could change drastically if it is later recalculated for some reason – a detour, or route edit on the device for example. This can be frustrating if it happens while out on the road. Recalculation can be avoided by setting “Off-Route Recalculation” to Off and being sure to not make any route changes.

One might wonder why a route would change dramatically: In addition to Via and Shaping points, imported calculated routes include large numbers of route point extensions, which are the result of previous route calculations. On recalculation, the route point extensions are discarded. The route is recalculated based on only the Via and Shaping points.

As far as I know, Trip Manager currently builds only uncalculated routes into .trip files. I think it probably could build .trip files containing calculated routes from gpx files containing calculated routes. Given the risk of significant route changes if later recalculated on the device, I’m not sure that it is a good idea.

I take the approach of recalculating the route on the XT or XT2 immediately after import or transfer, comparing it to the original, and adding additional [shaping] points as needed to produce matching routes. Again, it takes a little time, but I think it is worth the time. Others may disagree of course. The automatic route compare feature in the upcoming V1.5 should help to speed up that process.


Again, much of this is the nature of digital routing in general. I don’t think Garmin can solve it all, but I do think they could do better. After all, a lone man called Frank is making things better for all of us with Trip Manager.

... and much of what we know about zumo behavior is thanks to the significant efforts of @jfheath and others who post here.

Re: Introducing TripManager

Posted: Fri Jul 11, 2025 8:00 pm
by proofresistant
Wow, that was a detailed answer, comparable to those of @jfheath :-)

Re “don't know how to respond to the general ”refuses to work“.” Quite simply, if XT2 does not like a point, either the message appears in the wording (... calculation ...) and stops or the message appears in the wording (route cannot be calculated ...). Unfortunately, there is never any indication as to why :-(

Then I use shaping points, as many programs also support these. Between the points, a navigation system can do whatever it wants.

And then, yes, I have many sharpening points, and sometimes even use tracks.
Please bear in mind that I drive between densely populated metropolitan areas, sometimes off-road, so it makes sense to set narrow limits to the navigation system's own life in advance.

Comparing routes is another matter.
Yes, I do that too. And no, Basecamp is only suitable for good planning to a limited extent. If you then add traffic and roadworks from other tolls, it becomes quite complex.
Here I will highlight TripManager, so a comparison is a good thing with the tool, THANK YOU!

Then thank you, everyone's answers have shed light on the dark.
And another insight: Playing wireless routes on the Navie remains a requirement. All the booting is no longer state of the art, a nogo for a high-end device!

Then another tip, yes, while the XT2 synchronizes back and forth with the Tread app several times, even during calculations on the XT2, the XT2 is often many times slower.

PS
I am currently trying again with the Garmin support to tackle the problem with the shaping points and the Tread app and am also making examples again ;-)
I'm not letting up, although in theory I've already said goodbye to the XT2.
Wenn ich nun bei Garmin bleibe, dann dank TripManager oder Garmin bekommt das mit der Tread App mal hin ;-)
PS
I am currently trying again with the Garmin support to tackle the problem with the shaping points and the Tread app and am also making examples again ;-)
I'm not letting up, although in theory I've already said goodbye to the XT2.
If I stay with Garmin now, then thanks to TripManager or Garmin will get it right with the Tread app ;-)

Re: Introducing TripManager

Posted: Fri Jul 11, 2025 8:38 pm
by FrankB
smfollen wrote: Fri Jul 11, 2025 7:14 pm I think Frank’s intention with the optional post process route cleanup is an attempt to help those users who don’t check carefully. I would agree that the maps may be different and could be less accurate. It is the best Trip Manager can do. @FrankB Please correct me if I’ve got this wrong.
The way I do it is to first let TripManager fix the 'obvious' errors. In a 2nd pass I will go manually thru all the points. Examples of what TripManager can not do is when points are placed at junctions on the road that crosses, or points placed on highways with multiple lanes on the wrong side.
smfollen wrote: Fri Jul 11, 2025 7:14 pm As far as I know, Trip Manager currently builds only uncalculated routes into .trip files. I think it probably could build .trip files containing calculated routes from gpx files containing calculated routes. Given the risk of significant route changes if later recalculated on the device, I’m not sure that it is a good idea.
I dont think it's a good idea, but even if it would be a good idea. At the moment I cant. I'll give you a hex dump example of what I failed to decode, but is required by the XT(2) to accept it as a calculated trip. Look in the mUdbDataHndl for Unknown3 (People who cant stand Hex codes please ignore)
unknown3.jpg
unknown3.jpg (212.31 KiB) Viewed 1852 times
Frank
P.S.: I do think you deserve credits for the new Compare function. It was a "golden idea". (Probably not a well accepted English phrase)

Re: Introducing TripManager

Posted: Fri Jul 11, 2025 8:39 pm
by FrankB
proofresistant wrote: Fri Jul 11, 2025 8:00 pm If I stay with Garmin now, then thanks to TripManager or Garmin will get it right with the Tread app ;-)
<humour>Are you selling it cheap?</humour>

Re: Introducing TripManager

Posted: Tue Jul 15, 2025 12:44 pm
by jfheath
I'm only throwing snippets into this thread - when I spot something.

I spotted something:

Recalculation.

When the Zumo says that it is recalculating, it doesn't mean that it is recaclulating the route. It may be, but it might not be.

1) In the case of route placed as a .trip file in the .System folder - by Trip Manager - the XT2 has only the route points to work with. The route has to be calculated, and th etrip file has to be padded out with route infor gained from the map. It is up to the user to make sensible use of the route points - via and shaping - to try to prevent the XT2 from generating something stupid. And to do that, you have to remember that if there is a faster road nearby - closer than the next route point perhaps - then it is going to head for it. No matter where you thought you had plotted the route, the XT2 will probably come up with something different.

The good news is that if you also plot a track and load that - then you can see where the original routes went - and if you follow that route, the XT2 usually very quickly adjusts its route to go in the direction that you are heading. You don't get many repeated U turn requests. The XT2 seems to limit the number of those before finding another way.

2. For routes created as a GPX file and placed in internal storage/gpx - particularly if created by Basecamp or Mapsouce GPX v1.2 - the gpx file contains the original route and providing that the maps match, the XT2 will not recalculate the route - if Tread is not allowed to synch and if the route is 'nobbled' to have the mImported byte set to 0 = False = Saved.

But the XT2 will still say that it is calculating. It is busy taking date from the GPX route and building up a trip file. It is taking any Waypoints and putting them into the Waypoints area of the Explore database. It is also stripping all of the Waypoint definitions from the gpx file. Tracks - it puts those into a location where the Tracks App can get to them and removes them from the GPX file as well.
Unless other things demand a recalculation, then it leaves the route intact.


On a ride out on Sunday I had a vague route that someone esle was leading. I transferred it using TripPlanner and on loading the XT2 had to calculate - it said maps were different - you have to allow that, but it has to calculate anyway, because TripManager cannot plot the lines joing the route points. It also wants to recalculate due to a change in avoidances. I never found a way to prevent that- although I looked hard. You have the choice though yes or no.

What I got was a disaster. Not because of TM - but because my routing points were not sensibly positioned. The route took roads that I didn't want and some route points were moved to allow this. So although I have been using TM for some shorter routes and it has behaved impeccably, for this badly prepared route, I had to resort to the GPX file. It accepted the route without recalc and I used the XT2 copy command to reproduce the route so that it thinks that it is saved. I also had a track which I displayed under the route. Tread is loaded but it is not allowed to store data or to synch.

The route behaved impeccably well. A few places where I guess wrong about which way the leader would take us. And in one place the leader missed a turning so we all had to spin round. The XT2 behaved faultlessly - as it has done when I have been preparing my own routes and had the freedom to put in the shaping points and via points in locations.

But this reminded me. I had set myself the task of trying to find out what made the Zumo think that avoidances had changed. I was going to compare the trip files that had been created by the XT2 from a GPX file, with the same route loaded onto the Tread app and synched with the XT2, with the same route created on the XT2 itself. See if I can find anything that is of any use.

In the meantime, I have at last started the serie so web pages in this forum to do with getting the best out of the XT2. It is VERY early days. But the front pages of definitions are in place. They need tweaking - they are reminders of what we used to know before the XT2 came along.
And that is going to be the gist of the pages. How to make the XT2 work in a way that makes sense to people that have grown up with Zumos from the 590 (or earlier) onwards.

The pages will be published, before they are final - but I am not putting a link on the main menu - so please dont copy this link anywhere else. I am going to be describing what we think we know should happen, what goes wrong and how to work around it - and a summary of 'best' practice to make it work. But the key words - the points of reference - need to be there because thanks to MRA and other software, for too many people still think that a waypoint is any route point, or a waypoint is a via point, or a waypoint is a shaping point.

If you find the page for the main contents page for the XT1 pages. you get a link something like this

http: / / zumouserforums . co . uk / app.php / ZXT-P02

If you change that to say /XT2-P300 at the end - then that will point to the first page. There are only 4 pages of definitions at present. But I'll keep adding more pages. Please don't alert me to errors - I've not done a great deal of proof reading yet. I will have to come back to these pages as I progress with others.

Re: Introducing TripManager

Posted: Tue Jul 15, 2025 8:40 pm
by FrankB
jfheath wrote: Tue Jul 15, 2025 12:44 pm I'm only throwing snippets into this thread - when I spot something.
Keep throwing John!
jfheath wrote: Tue Jul 15, 2025 12:44 pm But this reminded me. I had set myself the task of trying to find out what made the Zumo think that avoidances had changed.
Maybe I'm not saying anything new to you, maybe it helps. Would love to check it myself, but you know I'm too gready to spend 500 Euro's on an XT2.

If I remember well we looked at the item 'mAvoidancesChangedTimeAtSave'. That item contains a Unix like date-time in 4 bytes. We started with putting in all zeroes, that had no effect. Next it was changed to put in the current date/time, same result.

What you could try, if not already tested, is to take the value from an already (re)calculated trip by the XT2 and put that in a trip file generated by TM. You could use the function 'Copy value from trip file'. The one you used when you found the 'mExploreUuid'.
copyvaluefromtrip.jpg
copyvaluefromtrip.jpg (43.8 KiB) Viewed 1755 times
If that works we can see how to change TM.

Another test you could do:
1. Remember the value 'mAvoidancesChangedTimeAtSave' of a calculated trip file. (Make a screenshot or similar)
2. On the XT2 change the avoidances. (Really have no idea how that looks on the XT2)
3. Recalculate the trip, and check if that value has changed. If it did not change, you/we are probably looking at the wrong item.

Dont hesitate to contact me if I can help. At your service!

Frank

Re: Introducing TripManager

Posted: Wed Jul 16, 2025 12:11 am
by jfheath
Thanks Frank

I'll revisit that - I remember trying all sorts of things with them without success and gave up as I reckoned that the route has got to be calculated anyway - and how different is it going to be when it recalculates it again ?

But I'm pretty sure that I didn't carry out the last test - which was to get a snapshot, change the avoidance get another and see what has changed - and then put that into a TM created trip. I did something similar, but I don't think it was that. I'll check my notes though - But I'm well aware that I gave up with it around that point and realised that it didn't matter a great deal. We were just happy that we'd found a couple of UUIDs that made it work for the XT2. I probably quit while I was ahead !