Kafka Queues and External GP Data Feeds

  • Kafka Queues and External GP Data Feeds

    Posted by David Morinello on September 1, 2017 at 12:26 pm
    • David Morinello

      Member

      September 1, 2017 at 12:26 PM

      ?Has anyone attempted to integrate External GP data feeds with Kafka queues? My company is considering implementing these queues and I need to educate myself (then IT) on how to best implement this in our environment.

      Is there a GP Connector for Kafka?
      What works or doesn’t with your implementation?
      What gotchasĀ should I be aware of?

      Any information will be more than what I have now and will be appreciated.

      ***
      We are on GP 2013R2 and have SSIS, EConnect, Scribe, SmartConnect, GP Web Services, etc.Ā all feeding data into GP and I am trying to tame this wild west environment into some type of standard.

      ——————————
      David Morinello
      Senior Dynamics GP Systems Architect
      Ascend Learning, LLC
      Leawood KS
      ——————————

    • Matthew Arp

      Member

      September 5, 2017 at 10:45 AM

      I am not aware of anyone integrating Dynamics GP into a Apache Kafka environment. That said it has been something I have been interested in. Just curious what kind of integration are you envisioning?

      ——————————
      Matthew Arp
      Business Systems Developer
      Hunton Group
      Houston TX
      ——————————
      ——————————————-

    • Bob DiPasquale

      Member

      September 5, 2017 at 11:38 AM

      Here’s a bit of reading about Kafka …

      Is Apache Kafka appropriate for use as a task queue?

      Stackoverflow remove preview
      Is Apache Kafka appropriate for use as a task queue?
      Join the Stack Overflow Community Stack Overflow is a community of 7.7 million programmers, just like you, helping each other. Join them; it only takes a minute: Sign up Kafka splits incoming messages up into partitions, according to the partition assigned by the producer. Messages from partitions then get consumed by consumers in different consumer groups.
      View this on Stackoverflow >

      … I was unable to quickly find any posts that relate GP with Kafka. Ā I hope you find the above helpful.

      ——————————
      Bob DiPasquale
      ——————————
      ——————————————-

    • John Steyer

      Member

      September 11, 2017 at 11:11 AM

      ?Our plan for Kakfa queues is to convert the XML standards from MSDN into Producers and Consumers topics in Kafka. GP will be the source for the Inventory Master and all of its component settings, which will become a Producer topic for the upstream systems to consume, such as CRM and webstores.

      We will also create a standard queue for the Customer Master and Customer Addresses and SOP transactions with and without payments. These queues will be consumer topics for GP and Producer topics for CRM and webstores.

      Any feedback to this model is appreciated.

      John

      ——————————
      John Steyer
      Program Manager – Corporate Applications
      Ascend Learning, LLC
      Leawood KS
      ——————————
      ——————————————-

    David Morinello replied 8 years, 8 months ago 1 Member · 0 Replies
  • 0 Replies

Sorry, there were no replies found.

The discussion ‘Kafka Queues and External GP Data Feeds’ is closed to new replies.

Start of Discussion
0 of 0 replies June 2018
Now

Welcome to our new site!

Here you will find a wealth of information created for peopleĀ  that are on a mission to redefine business models with cloud techinologies, AI, automation, low code / no code applications, data, security & more to compete in the Acceleration Economy!