GPT NLP Dialogue Interface

996
5
04-26-2023 09:20 PM
Status: Open
Labels (1)
LenBundra
New Contributor II

Esri should be working on a natural language dialogue interface for ArcGIS / ArcPro using GPT-4 !

Tags (4)
5 Comments
nicogis

Meanwhile I have developed an basic add-in that call gpt

nicogis/PAMChatGPT: Add-in ArcGIS Pro ChatGPT (github.com)

JonathanNeal

There is a meeting coming up in early May  https://spatial.ucsb.edu/events/all/2023/geography-according-chatgpt-kick

We have some thoughts and prototypes and would like our work to be community driven in this space.

Some interesting details that I have been looking at:
1. A User has a implemented their own single text box script tool that takes free text and runs arcpy code to do tasks. https://youtu.be/pF17FTzHR68
2. Wolfram has added an Add-in to OpenAI to help it send valid Wolfram API requests https://www.youtube.com/watch?v=EOQV9VakBgE
3. A door stop read of 325 pages from Standford on different types of machine learning models (GPT models really taking off and in the commercial sector now, so there will be lots of options to choose from). https://aiindex.stanford.edu/wp-content/uploads/2023/04/HAI_AI-Index-Report_2023.pdf
4. Bloomberg implemented their doc to use this: https://arxiv.org/abs/2303.17564
5. Microsoft has opened up their .NET 6.0+ API to run Models on Azure: Good Best Practice document even if you use a different GPT model: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/work-with-code#best-practic...
5. Great documentation on what GPT AI bugs look like and testing strategies, and awareness: https://cdn.openai.com/papers/gpt-4-system-card.pdf

JonathanNeal

@LenBundra If you could, it would be good to be specific on what you would like us to implement and why it will be useful to your work.  Maybe some of the context above is useful, but there are a lot of possibilities.

LenBundra

@JonathanNeal :

Here are some specific examples of work being done to ArcGIS by those outside of Esri:

Natural Language Dialogue interface for ArcGIS / ArcPro:

https://youtu.be/aVM_rvNoqvk

ChatGPT + ArcPro - YouTube

 

JonathanNeal

@LenBundra Yeah, a script tool with a single text box that "does everything" is the example we saw in 1.  on our above list.  What is really cool is that it can take in non-GIS speakers input and perform GIS analysis.
Your examples definitly have our interst in the Geoprocessing team and that case is being researched.