IDEA
|
Would be great to utilize this code in more places as well... Like being able to use it as arcg.is/shortcode
... View more
09-06-2020
07:48 AM
|
2
|
1
|
1436
|
IDEA
|
Sounds like configurable apps may see something implemented in the next AGOL update.
... View more
09-01-2020
03:52 PM
|
0
|
0
|
3136
|
POST
|
Re-validate your datastores and try restarting gisserver.gis/manager/site.html > Data Stores > Validate All
... View more
09-01-2020
03:49 PM
|
0
|
0
|
1215
|
IDEA
|
Per a discussion with the ArcGIS Online Team (Kelly Gerrow), they brought up that global IDs should be preserved where possible. In some instances (such as ArcGIS Roads and Highways and legacy applications with other systems/databases), that is not possible to do. I unfortunately can't find where I saw the best practices (help me out Kelly). We were experiencing both of what you mentioned. Some of our ETL datasets would just take a long time (and there's apparently an undocumented 2 hour timeout) while other datasets would exceed the 2 hour timeout and not sync at all. If you have a relatively small dataset, I think doing a truncate reload wouldn't be bad, but for larger ones it definitely doesn't work. We did notice that it seemed to work for a little while, but then it would fail to run, so I encourage you to do testing for at least a month or 2 before pushing your collaborations to production, so you don't have to spend a month or more undoing them like we have been doing. One other thing worth trying is splitting out your larger datasets into their own groups/collaboration workspaces so they are synced by themselves instead of with multiple datasets. We tried this and I don't think it worked very well, but you might have better success. A couple of other thoughts that came to mind... One of the esri guys on our call suggested using database hashes and comparing those to see if you really need to do a truncate/reload (Comparing Data of Two Oracle Tables Using MD5 Hash ). I also just came across this as well: How to copy or load data and preserve GlobalID values
... View more
08-11-2020
09:10 AM
|
0
|
0
|
871
|
IDEA
|
Per a discussion with the ArcGIS Online Team (Kelly Gerrow), they brought up that global IDs should be preserved where possible. In some instances (such as ArcGIS Roads and Highways and legacy applications with other systems/databases), that is not possible to do. I unfortunately can't find where I saw the best practices (help me out Kelly). We were experiencing both of what you mentioned. Some of our ETL datasets would just take a long time (and there's apparently an undocumented 2 hour timeout) while other datasets would exceed the 2 hour timeout and not sync at all. If you have a relatively small dataset, I think doing a truncate reload wouldn't be bad, but for larger ones it definitely doesn't work. We did notice that it seemed to work for a little while, but then it would fail to run, so I encourage you to do testing for at least a month or 2 before pushing your collaborations to production, so you don't have to spend a month or more undoing them like we have been doing. One other thing worth trying is splitting out your larger datasets into their own groups/collaboration workspaces so they are synced by themselves instead of with multiple datasets. We tried this and I don't think it worked very well, but you might have better success. A couple of other thoughts that came to mind... One of the esri guys on our call suggested using database hashes and comparing those to see if you really need to do a truncate/reload (Comparing Data of Two Oracle Tables Using MD5 Hash ). I also just came across this as well: How to copy or load data and preserve GlobalID values
... View more
08-11-2020
09:10 AM
|
0
|
0
|
693
|
BLOG
|
After switching from using FME (ArcGIS Data Interop) to using distributed collaborations to push data to ArcGIS Online, I would recommend going with FME/Data Interop every time and skip using collaborations. In fact we are going to be starting the process of reverting back to using FME/Data Interop from distributed collaborations because collaborations have some major issues that development lacked to put in the documentation, but I found out the hard way after going back and forth with support/development for 3 months which is that they don't support data that is truncated and reloaded (which is pretty much every data warehouse out there). We have data that our FME workspace has been writing at once a week (writes to SDE data warehouse), but the last time the service on AGOL was updated through the collaboration was in FEBRUARY!
... View more
06-09-2020
12:50 PM
|
1
|
0
|
3857
|
IDEA
|
Background: We tried to use distributed collaborations to keep our public facing ArcGIS Online services updated from our services on portal that were published from our data warehouse (which would get updated on a schedule). Apparently distributed collaborations DO NOT support services where the service has data that is completely truncated and reloaded (ie when moving data from a transactional database to a publication/data warehouse) because distributed collaborations use global IDs to compare changes and if you do truncate and reload an entire dataset, it apparently is double the work (it first deletes all the existing records since they no longer exist and then uploads the new records). Esri's workaround of comparing the transactional dataset to the publication dataset to do updates/deletes before inserts would be a major waste of processing time and slow down critical databases and processes running the ETL. Idea: Distributed Collaborations needs to have an option to that bypasses the delta comparisons and simply drop/truncate the table in the organizations that it's being shared to and then append the exported replica. This would support many workflows and make life so much more simplistic for those of us who want to use distributed collaboration at an enterprise level to push data to ArcGIS Online. Kelly Gerrow Paul Barker
... View more
05-22-2020
09:45 AM
|
4
|
2
|
1036
|
IDEA
|
Background: We tried to use distributed collaborations to keep our public facing ArcGIS Online services updated from our services on portal that were published from our data warehouse (which would get updated on a schedule). Apparently distributed collaborations DO NOT support services where the service has data that is completely truncated and reloaded (ie when moving data from a transactional database to a publication/data warehouse) because distributed collaborations use global IDs to compare changes and if you do truncate and reload an entire dataset, it apparently is double the work (it first deletes all the existing records since they no longer exist and then uploads the new records). Esri's workaround of comparing the transactional dataset to the publication dataset to do updates/deletes before inserts would be a major waste of processing time and slow down critical databases and processes running the ETL. Idea: Distributed Collaborations needs to have an option to that bypasses the delta comparisons and simply drop/truncate the table in the organizations that it's being shared to and then append the exported replica. This would support many workflows and make life so much more simplistic for those of us who want to use distributed collaboration at an enterprise level to push data to ArcGIS Online. Kelly Gerrow Paul Barker
... View more
05-22-2020
09:45 AM
|
4
|
2
|
858
|
POST
|
We're running into major issues with using distributed collaborations to copy our services that we want to make public to ArcGIS Online, and this is all due to lack of documentation (in this case specifically related to the limitations of distributed collaborations). We've had a case open with support for awhile now and still aren't even close to a solution or workaround using distributed collaboration. I can't imagine that we're the only organization getting problems. We do a true truncate/reload on the services, which I'm told may be part of the problem. Are your scheduled syncs "completed" successfully or are they "completed_with_failures"? Upload and import replication package to peer (in this case ArcGIS Online Org) errors which we think are leading to some other errors that are causing items to become disconnected: javax.net.ssl.SSLException: Connection reset by peer (Write failed) javax.net.ssl.SSLException: Broken pipe (Write failed)
... View more
05-08-2020
02:01 PM
|
0
|
1
|
662
|
POST
|
Since the Dev Summit got cancelled, is there anywhere this 10.8 and post 10.8 stuff will be posted/shared?
... View more
03-30-2020
01:05 PM
|
0
|
1
|
724
|
IDEA
|
Would be nice to be able to define what sends a notification by counter type (ArcGIS Server, Portal, Ext, Process, System, etc), the warning type (Critical, Warning, Info), and the time it occurs (which is set in the config file right now at a global level). Additionally getting to define notifications by the above by each specific counter would also be really great. Derek Law Comes from the symptom of this idea (getting too many alerts): https://community.esri.com/ideas/16390 , but would allow you to better detail the configuration of the notifications.
... View more
01-28-2020
07:59 AM
|
6
|
2
|
733
|
IDEA
|
Would be nice to be able to define what sends a notification by counter type (ArcGIS Server, Portal, Ext, Process, System, etc), the warning type (Critical, Warning, Info), and the time it occurs (which is set in the config file right now at a global level). Additionally getting to define notifications by the above by each specific counter would also be really great. Derek Law Comes from the symptom of this idea (getting too many alerts): https://community.esri.com/ideas/16390 , but would allow you to better detail the configuration of the notifications.
... View more
01-28-2020
07:59 AM
|
3
|
1
|
527
|
IDEA
|
Even more useful than this would be to make Ops Dashboard responsive, so it could work and actually be functional on mobile devices. This is something that has held us back from using Operations Dashboard when there could be users on mobile devices.
... View more
01-27-2020
12:29 PM
|
0
|
0
|
252
|
IDEA
|
Would be nice to be able to filter (turn on/off) the data in the charts by clicking on the color in the column to the left of Item
... View more
01-27-2020
11:50 AM
|
4
|
1
|
442
|
IDEA
|
Would be nice to be able to filter (turn on/off) the data in the charts by clicking on the color in the column to the left of Item
... View more
01-27-2020
11:50 AM
|
8
|
3
|
835
|
Title | Kudos | Posted |
---|---|---|
1 | 06-09-2020 12:50 PM | |
2 | 08-09-2019 08:22 AM | |
2 | 09-06-2020 07:48 AM | |
2 | 10-01-2019 11:13 AM | |
4 | 05-22-2020 09:45 AM |
Online Status |
Offline
|
Date Last Visited |
11-11-2020
02:24 AM
|