Demo

Note №2

Multi-layer graph PrivateAI (Word graph)

Word graph

Word graph is a local graph, which has a selected word in center and top-N words around, most commonly used in articles with selected word. Each node is provided with at least one link leading to appropriate article tab with article-wide graph and ability to request access to this article.

To compute word graph, we search for most connected words for a given word. Here is the code implementation:

Edges conflicts

In cases, when links in edges conflict with each other, like “[Alcohol] enhances [organism]” and “[Alcohol] is harmful for [organism]”, according to 2 different articles, we can mark it with different colors in order to make graph more representative and involve users into research process.

Here are 2 good approaches:

VADER (NLP method)

Pros: instant speed

Cons: not accurate

HuggingFace Transformers

Pros: accurate

Cons: not fast (5+ seconds), uses 200MB Transformers model

Other diaries

Note №6

Embeddings

June 14, 2024

A series of tests with Mixtral prompts revealed that by using special hints like [INST] [/INST], the model produces much better...

READ MORE

Note №5

Peer-review

June 7, 2024

Focus is on describing the article review process, which is a combination of two main tasks. The first task is to identify the criteria by which the model will evaluate articles...

READ MORE

Note №4

Multi-layer graph PrivateAI (Source code)

May 31, 2024

To construct the graph, the shared_word_graph method is used and the following steps are implemented...

READ MORE

Note №3

Multi-layer graph PrivateAI (Brief overview)

May 31, 2024

Previously, was illustrated the general concept of using graph visualization to provide a more intuitive and convenient way for users to navigate and explore...

READ MORE