Demo

Note №3

Multi-layer graph PrivateAI (Brief overview)

Brief overview

Previously, was illustrated the general concept of using graph visualization to provide a more intuitive and convenient way for users to navigate and explore the vast amount of information available on the platform.

In that concept, two graphs were used: 

  1. Global graph - aggregates all graphs for each article available on the PrivateAI platform.
  2. Word graph - local graph that is extracted from the global graph with the selected word at its center.

For now, in order to increase the convenience of global graph search, we propose to implement a Shared context graph which will help users navigate through different levels of graphs. 

Shared context graph

Shared context graph - is an alternative representation of word graph. 

It works as follows: 

  • Search of all article graphs containing the selected word
  • The found graphs are combined together to form a shared context graph
  • To prevent  graph overload, when we have a very common/popular word, we divided all these article graphs into batches of N (configurable parameter) to show the combination of only N graphs at once
  • User can switch between these batches in the ‘page’ view

This way allows visualizing the overall context in which the selected word occurs and exploring the links between it and other words in the context of different articles.

Examples

1. Example of shared word graph for word “Age”

2. Example for word “Evolution”:

Other diaries

Note №6

Embeddings

June 14, 2024

A series of tests with Mixtral prompts revealed that by using special hints like [INST] [/INST], the model produces much better...

READ MORE

Note №5

Peer-review

June 7, 2024

Focus is on describing the article review process, which is a combination of two main tasks. The first task is to identify the criteria by which the model will evaluate articles...

READ MORE

Note №4

Multi-layer graph PrivateAI (Source code)

May 31, 2024

To construct the graph, the shared_word_graph method is used and the following steps are implemented...

READ MORE

Note №2

Multi-layer graph PrivateAI (Word graph)

May 27, 2024

Word graph is a local graph, which has a selected word in center and top-N words around, most commonly used in articles with selected word. Each node is provided with at least one...

READ MORE