Tag: Education

Advancing Full-Text Search: Testing and Refining with Multi-User Platforms | July 06 2025, 04:35

I have developed expertise in full-text search testing. Essentially, it’s a turnkey multi-user platform that, given roughly 1000 queries and several search engine configurations, can produce reports with graphs, metrics, and conclusions by morning, showing why configuration A performs better than B, and here’s why. It calculates all those NDCG@k, MAP, precision, recall, and about a dozen other metrics. It uses LLM, but only at the final stage, after all the math is done.

So, here’s my question. I’m looking for someone who has faced the same issue in their project, to understand the demand and the ask.

The problem the system solves is defined as follows: there is a functional search for goods, documents – Solr, Coveo, Elasticsearch, Algolia – it doesn’t matter, and there are hypotheses on how to improve it, but there is also the fear that improving one aspect might break another. Well, my thing helps to see this in numbers and graphs, providing a conclusion with justification, including statistical significance and other metrics.

It also acts as a virtual search assessor. For each search result, it can give a rating, assessing how well each document matches the query. This is a very non-trivial task (especially for large documents), involving chunking, embeddings, LLM evaluation of relevant chunks, etc. Non-trivial, but it works.

It also can analyze search queries and break them into groups based on similarity. For instance, such segmentation might show that users sometimes separate the words forming a brand name with a space, and sometimes not. These different variants would be grouped together.

I would like to discuss this with someone who knows more about this topic than I do, someone who has/had such problems and has somehow solved them.

I currently feel like my product is unique in the market. Actually, it’s not even on the market yet. But I really don’t see anything similar out there. Maybe nobody needs it?

I won’t publically post screenshots yet. The picture is merely for attracting attention.

Please share if there might be relevant people in your network.

Exploring the Luminescent Life of Fireflies | July 05 2025, 05:02

While walking with Yuka, suddenly the owner falls on his knees and digs around in the grass for a while. That’s when I found a firefly and wanted to capture it lighting up. The firefly Photinus pyralis is quite common here, but I never got around to studying it closely.

Interestingly, the females of another genus of fireflies, Photuris, use the flashes of Photinus males to locate and eat them. It has been discovered that the females acquire special steroids called lucibufagins from their prey, which repel spiders.

(While figuring this out, I learned something new. Luciferase, an enzyme responsible for the glow, is extracted from these fireflies. It’s named after the word Lucifer, Latin for “light-bearer.” Interestingly, Greece also had its Lucifer, “light-bearer,” known as the god Phosphorus. Incidentally, the element Phosphorus was discovered by alchemist Hennig Brand through the evaporation of urine. He named the discovered element phosphorus mirabilis, from Latin meaning “miraculous light-bearer.” This just shows how many things in the world are connected.)

Unveiling the Mystery of the Original Declaration of Independence | July 04 2025, 02:36

Tomorrow is July 4th – Independence Day.

I’m currently reading about it. It turns out that the authentic Declaration of Independence is lost to history, and the document labeled “Original Declaration of Independence” in the National Archives is actually a copy.

By the way, about 80% of the text of the declaration lists why the king is bad. Literally. He doesn’t do this, he doesn’t do that, he forgot about us here, he didn’t remember there. It’s just a straight protest of no kings. The last paragraph of the long text essentially says, in sum, forget him. We want to handle it ourselves.

Jefferson prepared the draft of the Declaration of Independence with all the usual revisions—crossed out words, inserts in the gaps, etc., all written in his poor handwriting. This document exists and is very interesting.

The rest of the committee approved the text, and Jefferson then created a fair copy (still in his bad handwriting and just the size of a regular sheet), which was presented to Congress, voted on, adopted, and received its first signatures. This “fair copy” was the real original Declaration of Independence—and it is precisely this one that is lost.

Later, Congress decided that a version suitable for publication was needed—bigger and, of course, not written in Jefferson’s terrible handwriting. For this, they hired a professional copyist. When he made his copy, Congress held a re-signing. This version by the copyist has the label “Original Declaration of Independence” on the back and is the one currently displayed in the National Archives. It was “original” only in the sense that it served as the master copy for printing.

So what happened to Jefferson’s “fair copy,” the genuine original Declaration of Independence? No one knows. It might still be somewhere in the archives, lost among other documents. Or perhaps someone took it home and preserved it, or maybe it was destroyed by time and circumstances, such as when the British burned Washington.

In 1989, a man named Michael Sparks bought an old painting at a flea market in Pennsylvania for $2.48. When he removed the frame, he discovered a rolled-up piece of paper behind it. This turned out to be one of the rare “Dunlap Broadsides”—the first 200 printed copies of the U.S. Declaration of Independence, printed on the night of July 4 to 5, 1776, by John Dunlap.

This find was in excellent condition and was sold at a Sotheby’s auction in 1991 for 2.42 million dollars (and later resold for even more). This isn’t Bitcoin!

A bit about the dates. On July 2, Congress voted for independence. Not the 4th. On July 4, it was formally ratified by Congress, they spent two days making minor formal amendments, having already decided on the substance. No signatures yet. The date on the document, of course, is the 4th. Copies were printed and sent out the next day. Eventually, the ones sent out were signed by the delegates only on August 2.

Three of the first five American presidents died on this day. Jefferson, Adams, Monroe. Jefferson was in fact the father of this declaration, with Adams, they found the time. So maybe July 2nd would be a more appropriate day to celebrate.

Yes, also—technically—America did not gain independence in 1776. It happened only after the signing of the Treaty of Paris (September 3, 1783), when Britain said: “Alright,” and recognized America as a separate state.

If the War of Independence hadn’t turned in favor of America, Washington (like most of the founding fathers) would likely have been executed for treason. But since it turned out otherwise, they picked that day.

Understanding Lens Distortion in Oil Painting from IKEA Photo References | July 02 2025, 21:55

Before painting it with oil, I study the perspective in a specific photo from IKEA. And here it is very noticeable why photo references should be used cautiously for drawing: camera lenses introduce significant distortions (this was already known and visible, the question is which ones and how to fix them when transferring onto a canvas). Look at this, the ellipses in pink and green were added by me, as well as the vanishing point and lines to it. Everything on the edge is distorted. Pay attention, for instance, to the neck of the bottle on the left.

A good exercise to prepare everything in advance on the canvas.

Understanding Road Grade: The Math Behind the 10% Incline Sign | June 30 2025, 19:48

It turns out that the incline (incline, or grade) – the steepness of a road or slope – has quite an obvious definition, but I never really thought about it. It means the ratio of the projection of a line on the terrain to the vertical plane to the projection of the same line on the horizontal. In other words, the magnitude of the incline equals the tangent of the angle between the rise of the slope and the horizontal (the tangent of the angle of inclination).

Thus, a “steep climb” sign of 10% indicates just about 5.71 degrees of inclination. This is arctan(0.1).

It also turned out that formally among specialists when reading the notation, the “%” sign is pronounced as “hundredths.”

Galactic Etymology: Tracing the Milky Origins in the Night Sky | June 29 2025, 12:57

I am looking at photos and reading material about the Milky Way and noticed that the word galaxy (any) essentially means “milky” from Greek. Κύκλος Γαλαξίας. Essentially, lac from lactose, and gala from galaxy essentially come from the same Proto-Indo-European ģlákts. Unexpected.

Unveiling Ancient Numeric Codes in “Slave for Sale” by José Jiménez Aranda | June 27 2025, 21:00

An interesting painting “Slave for Sale” (Una Esclava en Venta), 1897, by Spanish artist Jose Jimenez Aranda.

From it, I learned that just as there were Roman numerals, there were Greek ones in Greece. Pay attention to the plate. It reads ΡΟΔΟΝ ΕΤΩΝ ΙΗ ΠΩΛΕΙΤΑΙ ΜΝΑΣ Ω, which translates to “Rhodon, 18 years old, for sale for 800 minae”.

In the Greek text, there are two numbers – ΙΗ and Ω. In those times, Greeks wrote numbers using letters: Α (alpha) = 1, Β = 2, …, I = 10, K = 20, …, Ρ = 100, Σ = 200, …, Ω = 800.

Accordingly, ΙΗ is 18. The line above it indicates that it is a number, as does the line above Ω.

Faustian Dialogues in Modern Project Management | June 20 2025, 15:00

I think project managers can very well speak to developers in the words of Faust.

Well, here we go again, in the old manner

With you – all is uncertainty, all doubts,

In everything you create difficulties,

And for all, you wish for new rewards!

When will you, without any further talk, —

One, two: look, — and everything is ready soon!

(For context – this is Faust’s reaction to the refusal of the seemingly omnipotent Mephistopheles (Devil) to bring Helen of Troy and Paris from the realm of shadows to the stage for the Emperor’s amusement)

director

Don’t forget anything:

What can be done immediately,

Why put it off till tomorrow?

We must instantly grasp

All that is necessary and possible

(…)

“You have poorly executed it,

And left a gap in the corner”

And the designer might reply:

And you do not see, how vile and shameful

This craft?

Am I not an artist?

To the Manager:

“Fire! Help! Hell! We are all going to burn now!”

Switching to Pencil: Mastering the Art of Drawing with Three and a Half Rules | June 20 2025, 12:53

In the studio, we decided to switch from oil to pencil, which I hadn’t touched for years (and, frankly, never really knew how to use properly). But with practice, I understood just three and a half rules of good drawing.

1. Draw what you see, not what you think you should see if you look at the reference. This is the most difficult part because it involves fighting your own brain, which is convinced it knows what things look like.

2. Judgment of proportions. If something occupies a fifth on the reference, you need to distinguish it from a sixth or a fourth, and of course, see exact halves and thirds clearly. It’s like having a musical ear. If an imaginary line ends at a point on the ear, you need to see this imaginary line. It’s not hard, but requires practice, and it seems you need to practice it all your life. Interestingly, you are initially surprised at how wrong you are about proportions. There are many small optical illusions that one must get used to.

2.5. Angles. A continuation of judging proportions. You need to see the difference between, say, 45 and 40 degrees at least. And see where to turn the wrong line and by how much.

3. Ability to simplify. Any complex shape needs to be simplified in the mind to straight lines and shapes and draw those first, and also to reduce reality to spots of a maximum of a few shades (with white and black at the edges).

That’s all. If you master just these three and a half points, you won’t need anything else for a long time. No knowledge of anatomy, understanding of materials, or laws of perspective (all this is important, but comes later).