Pular para o conteúdo principal

Top Trends in Data and Analytics for 2021 by GARTNER

Distributed everything — data, people and devices — is accelerating. Using graph techniques to uncover connections in combinations of diverse data at scale enriches data management, analytics, AI and machine learning (ML), and enables innovation. Leveraging distributed D&A that resides in edge computing environments, while giving every distributed user dynamic insights, represents new opportunities for competitive differentiation and operationalizing business value.

Distributed Everything

Trend 8: Graph Relates Everything

Analysis by: Afraz Jaffri, Ankush Jain, Jim Hare, Pieter den Hamer
 
SPA: By 2025, graph technologies will be used in 80% of data and analytics innovations, up from 10% in 2021, facilitating rapid decision making across the enterprise.
 
Description:
Graph technologies encompass a wide variety of solutions that work with data represented as a set of nodes and edges instead of tables, rows and columns. It allows us to find relationships between people, places, things, events, locations etc. across diverse data. This structure intuitively models relationships between entities and can capture business knowledge, making it easier to perform queries and answer questions. In addition, modeling data as a graph opens up new analytical insights through the use of graph algorithms.
Graphs are forming the foundation of many modern data and analytics capabilities. Increased understanding and collaboration with business users, organizing and preparing data for downstream processes, uncovering hidden insights, improving ML model creation and providing explainable AI are just some of the uses driven by different graph technologies and techniques.
 
Why Trending:
  • Complex business problems require contextual awareness and understanding the variable nature of connections and strengths across multiple entities, such as organizations, people or transactions. Critical business questions that used to take months to answer can now be solved in minutes.
  • Graphs form the foundation of modern D&A, with capabilities to enhance and improve user collaboration, ML models and explainable AI. The recent Gartner AI in Organizations Survey demonstrates that graph techniques are increasingly prevalent as AI maturity grows, going from 13% adoption when AI maturity is lowest to 48% when maturity is highest.
  • No- and low-code tools that enable visual exploration and interaction with a graph are enabling insights to be found without the need for graph query languages.
  • Improved, scalable and lower-cost processing options, including cloud-based services and dedicated hardware, are making graph analytics and databases prime candidates for accelerated adoption.
  • Knowledge graphs can form a key component of data fabrics and give structure to images, audio, video and natural languages. They do so by exposing metadata and business rules, enabling data scientists to quickly identify and use the data they need while preserving context and representing all forms of data in a standard queryable format.
Implications:
  • A change in thinking and development of a “graph mindset” are taking place as more organizations identify use cases that graph techniques can solve. Up to 50% of Gartner inquiries on the topic of AI involve discussion of the use of graph technology.
  • The number of products that incorporate graph technology will increase. Within these products, the use of graphs may or may not be visible to end users, resulting in duplication and redundancy. There needs to be an understanding of when an underlying graph model can be exposed, and how multiple graphs can be combined.
  • AI solutions will evolve from being based on one type of model, or ensemble of models, to being made of composite models, with graph techniques playing a prominent role. The use of graph techniques will require a broader and deeper set of data science and AI skills with specialist roles, such as graph engineer and ontology manager, appearing, as well as existing roles in data science teams becoming proficient in graph techniques.
  • Graph technology underpins the creation of richer semantic models that can enhance augmented analytics models, as well as the richness of conversational analytics. Organizations that use graphs and semantic approaches for natural language technology projects will have less technical debt than those that do not.
Actions:
  • Complement traditional analytics with graph technology when the primary business questions are about the relationships between data rather than data values themselves.
  • Deduce actual relationships among data in multiple data stores and identify enforced and implied relationships in the data across the organizational silos by taking advantage of graph-enabled data and metadata management capabilities..
  • Examine business processes that have a high potential for optimization through the use of graph techniques and algorithms by creating a conceptual graph domain model for the process and testing scenarios that graph algorithms could solve.
  • Identify potential use cases that can be simplified or accelerated with graphs for ML by evaluating existing models that require intensive data preparation and feature selection workflows.

Fonte: https://www.gartner.com/doc/reprints?id=1-2596RUH7&ct=210219&st=sb&aliId=eyJpIjoiV1BjeVpiejVqUHJYWFA0diIsInQiOiJteG4xMnFxUEE4UjFlXC9mVXRBbnV3UT09In0%253D

Comentários

  1. De acordo com o Gartner, Grafo continuam sendo um tendência na área de dados (2019, 2020, 2021)

    ResponderExcluir

Postar um comentário

Sinta-se a vontade para comentar. Críticas construtivas são sempre bem vindas.

Postagens mais visitadas deste blog

Connected Papers: Uma abordagem alternativa para revisão da literatura

Durante um projeto de pesquisa podemos encontrar um artigo que nos identificamos em termos de problema de pesquisa e também de solução. Então surge a vontade de saber como essa área de pesquisa se desenvolveu até chegar a esse ponto ou quais desdobramentos ocorreram a partir dessa solução proposta para identificar o estado da arte nesse tema. Podemos seguir duas abordagens:  realizar uma revisão sistemática usando palavras chaves que melhor caracterizam o tema em bibliotecas digitais de referência para encontrar artigos relacionados ou realizar snowballing ancorado nesse artigo que identificamos previamente, explorando os artigos citados (backward) ou os artigos que o citam (forward)  Mas a ferramenta Connected Papers propõe uma abordagem alternativa para essa busca. O problema inicial é dado um artigo de interesse, precisamos encontrar outros artigos relacionados de "certa forma". Find different methods and approaches to the same subject Track down the state of the art rese...

Knowledge Graph Embedding with Triple Context - Leitura de Abstract

  Jun Shi, Huan Gao, Guilin Qi, and Zhangquan Zhou. 2017. Knowledge Graph Embedding with Triple Context. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management (CIKM '17). Association for Computing Machinery, New York, NY, USA, 2299–2302. https://doi.org/10.1145/3132847.3133119 ABSTRACT Knowledge graph embedding, which aims to represent entities and relations in vector spaces, has shown outstanding performance on a few knowledge graph completion tasks. Most existing methods are based on the assumption that a knowledge graph is a set of separate triples, ignoring rich graph features, i.e., structural information in the graph. In this paper, we take advantages of structures in knowledge graphs, especially local structures around a triple, which we refer to as triple context. We then propose a Triple-Context-based knowledge Embedding model (TCE). For each triple, two kinds of structure information are considered as its context in the graph; one is the out...

KnOD 2021

Beyond Facts: Online Discourse and Knowledge Graphs A preface to the proceedings of the 1st International Workshop on Knowledge Graphs for Online Discourse Analysis (KnOD 2021, co-located with TheWebConf’21) https://ceur-ws.org/Vol-2877/preface.pdf https://knod2021.wordpress.com/   ABSTRACT Expressing opinions and interacting with others on the Web has led to the production of an abundance of online discourse data, such as claims and viewpoints on controversial topics, their sources and contexts . This data constitutes a valuable source of insights for studies into misinformation spread, bias reinforcement, echo chambers or political agenda setting. While knowledge graphs promise to provide the key to a Web of structured information, they are mainly focused on facts without keeping track of the diversity, connection or temporal evolution of online discourse data. As opposed to facts, claims are inherently more complex. Their interpretation strongly depends on the context and a vari...