Building Structure Into Unstructured Knowledge
There is a tax that almost every professional pays after a few years of serious work, and almost nobody has a line item for it. It is levied every time somebody thinks the sentence I know I wrote that down somewhere. It is paid in the twenty minutes spent looking, and again in the fifteen minutes spent reconstructing from memory after the looking failed, and again in the slow erosion of confidence that comes from repeatedly discovering that your own accumulated work is not actually available to you. The material exists. That is the frustrating part. Nothing was lost, nothing was deleted, nothing was stolen. It is simply that a document written three years ago under a filename that made sense that Tuesday now sits in a folder whose organizing logic has been superseded twice, alongside four hundred other files with the same problem.
The usual diagnosis is that people are disorganized, and the usual prescription is discipline, and both are wrong in a way that keeps the problem in place. The people paying this tax most heavily are not careless. Teachers who write detailed plans, researchers who annotate every paper they read, engineers who document their failures, and clinicians who record their reasoning are by definition people who take the trouble to write things down. What they lack is not diligence. What they lack is structure, and structure is a different kind of thing from content: it is the arrangement that makes content addressable, and it does not appear as a side effect of writing carefully.
The distinction becomes clearer once you notice that search alone does not solve it. Full-text search across a large body of unstructured material is genuinely useful and genuinely insufficient, because it answers only the questions you can phrase in the vocabulary the document happened to use. It cannot tell you that a lesson plan and a lab safety sheet and a set of student results belong to the same unit. It cannot tell you which of forty papers you considered essential. It cannot distinguish a passing mention from a central treatment. Search retrieves strings; structure retrieves meaning, and the two are complementary rather than interchangeable.
What makes the situation genuinely recoverable, and this is the part people find surprising, is that structure can be added retroactively in a way that content cannot. A memory that was never written down is gone. A document that was written and filed badly is not gone; it is merely unaddressed, and addressing is work that can be done later. Years of accumulated material can be brought into a coherent arrangement by somebody willing to spend a number of evenings doing it, and the material becomes more valuable in the process rather than merely more findable, because deciding where something belongs requires understanding what it actually is.
That last point is the one worth dwelling on, because it explains why the exercise repays more than the time it costs. Structuring is not administrative overhead performed on knowledge that already exists in finished form. It is a form of processing. A teacher who breaks a lesson into objectives, materials, procedure, assessment, and reflection is not filing a document; they are examining whether the lesson has a coherent arc, and they will notice the gap where the assessment does not test what the objectives claimed. A researcher who summarizes a paper into methods, findings, relevance, and personal commentary is not making a record; they are being forced to state what the paper actually established as distinct from what it asserted, and the act of separating those is most of what critical reading consists of.
The requirements this places on a tool are specific and not especially exotic. Hierarchy has to nest deeply enough to hold a domain’s real shape, and it has to be rearrangeable, because the correct structure is discovered rather than designed and the first attempt is always wrong somewhere. A second organizing axis has to exist alongside the hierarchy, since every body of knowledge contains categories that cut across the tree and forcing them into it produces either duplication or distortion. Individual items need internal structure, so that a single note can carry several distinct kinds of content without merging them. And search has to be aware of all of this, weighting a match in a title differently from a match buried in an attachment, so that the effort spent on structure is repaid in retrieval quality rather than ignored.
What follows is a conversation between two people who arrived at almost identical answers from opposite ends of the education pipeline, one teaching sixteen year olds about reaction energetics and the other four years into a molecular biology doctorate, neither of whom had any reason to expect the other’s system to look like their own.
Two screens, six thousand miles, one identical complaint
The call connected at four in the afternoon in San Antonio, which made it ten at night in London, and both of them apologised for the time before either said hello properly.
‘This is genuinely the best part of my day,’ Priya Sharma said, ‘so please do not apologise. I have been staring at a gel image since two and my capacity for new information peaked around six.’
‘I have been standing up since seven thirty,’ Tomas Herrera said. ‘I teach four sections of chemistry and coach robotics on Tuesdays, so sitting in a chair and talking to an adult about filing systems is essentially a spa treatment.’
Priya laughed. Behind her a lab office was visible in the unflattering way that video calls reveal offices: a bench, a whiteboard covered in something that had been erased incompletely several times, a shelf of binders and a kettle. Behind Tomas was a classroom after the bell, chairs on desks along one wall, a periodic table poster that had been laminated at some expense, and a whiteboard with a half-erased energy diagram on it.
They had been put in touch through the messaging group, which had by then acquired the character of a small professional association nobody had formally founded. Somebody had mentioned that a high school teacher in Texas had built one of the more thorough page hierarchies they had seen, and Priya had asked to be introduced, and Tomas had replied within four minutes because he had been at lunch duty and grateful for the distraction.
‘I want to say something first and I want you to take it in the spirit it is meant,’ Priya said. ‘I was surprised.’
‘That a high school teacher uses this seriously.’
‘Yes, and I am embarrassed about the surprise, which is why I am naming it.’ She was direct about it, which Tomas immediately liked. ‘I had a picture of who else was doing this and it was researchers, journalists, lawyers. People with an obvious information problem. And then somebody described your unit structure and it was more disciplined than mine.’
‘Everyone is surprised,’ Tomas said, entirely without offence. ‘And the reason everyone is surprised is that people underestimate how much information a teacher actually produces. I am in my sixth year. Four sections, two preparations, roughly a hundred and eighty instructional days a year. Every one of those days has a plan, materials, a handout or a lab sheet, something I noticed afterward, and student work I looked at.’
‘Multiply that out.’
‘I did, once, and then I stopped doing arithmetic about it because it was upsetting.’ He grinned. ‘Somewhere north of four thousand documents that matter and about twice that many that do not, and the ones that matter are indistinguishable from the ones that do not in a folder listing.’
Priya was nodding before he finished.
‘Four years in,’ she said. ‘Around eleven hundred papers I have actually read rather than downloaded, which is a distinction I want on the record. Two lab notebooks, both scanned. Experiment logs for something like three hundred runs, most of which failed, which is normal and which means the failures are the majority of my archive and also the majority of what I need to look back at.’
‘And you could find none of it.’
‘I could find all of it, theoretically, which was the exact problem.’ She leaned toward the camera. ‘This is the thing I could not explain to my supervisor for about two years. Everything was searchable. I had a folder structure. I had a reference manager. If you had asked me whether I was organized I would have said yes and I would have believed it. And then somebody in a meeting would refer to a paper we had discussed in the spring and I would have absolutely no route back to what I had thought about it.’
Tomas made a small noise of recognition.
‘Say the version of that from my side,’ he said, ‘because I think it is the same sentence. In April I teach thermochemistry. Every April I teach thermochemistry. And every April I would sit down and build it again from something close to scratch, not because I had lost the previous version but because retrieving and evaluating the previous version cost more than rebuilding.’
‘That is exactly it.’
‘Six years,’ Tomas said. ‘Six versions of the same unit, each one built partly from memory, each one containing improvements that the next one did not inherit, because the improvements were in a file I could not efficiently locate and could not tell apart from four other files with similar names.’
Priya was quiet for a second.
‘I want to be precise about what that costs,’ she said. ‘Because it is not the time. The time is annoying and survivable. What it costs is that you stop getting better at the thing. Every year you rebuild from partial memory, you lose the accumulated correction.’
‘That is the sentence,’ Tomas said. ‘That is the whole reason I did anything about it. Not efficiency. I was not becoming a better teacher at the rate I should have been, and the reason was structural rather than personal.’
Two trees, drawn without consulting each other
‘Screen share,’ Priya said. ‘I want to see the tree everyone talks about.’
Tomas shared, and his sidebar filled the panel. He collapsed everything first, which she noticed and approved of, because a person who demonstrates a hierarchy expanded is showing off rather than explaining.
‘Top level is the course,’ he said. ‘AP Chemistry, Chemistry I, Robotics, and one called Department, which is everything that is not teaching. Under a course, the semester. Under the semester, the unit. Under the unit, entries.’
He expanded down through it as he spoke: AP Chemistry, then Fall, then Thermochemistry, and the middle column filled with entries whose titles read like the contents of a working teacher rather than a filing system. Day 1, calorimetry introduction. Coffee cup calorimeter lab. Hess’s law practice set. Enthalpy diagrams, the version that finally worked. Unit assessment. What went wrong with the specific heat lab.
‘Four levels,’ Priya said.
‘Four levels of page and then entries and then sections inside the entries, which we should talk about separately because sections are the part that changed everything.’ He clicked into one. ‘And the pages carry icons and colour dots, which sounds decorative and is not. Every lab-heavy unit has the same colour. When I open the sidebar at seven in the morning with a coffee I am not reading, I am pattern matching, and colour gets me to the right branch about a second faster than text does. A second, forty times a day, is a real number.’
‘Mine is the same depth and the labels are entirely different,’ Priya said, and shared her own.
‘Top level is Thesis. Beneath it, chapters, six of them, named by their working titles rather than by number, because the numbers changed twice and the names did not. Beneath a chapter, sub-topics, which are the actual conceptual divisions of that chapter. And beneath those, entries. One per paper. One per experiment. One per protocol.’
Tomas leaned in.
‘Your leaves are papers.’
‘One entry per paper, always, and that was the first decision I made and the one I would defend hardest,’ Priya said. ‘Because a paper is a thing with an identity. It has a title, authors, findings, and my opinion of it, and that opinion changes over four years. If a paper is a paragraph inside a note called Reading, February, it has no identity, it cannot be labelled, it cannot be linked to a chapter, and my opinion of it cannot evolve because there is nowhere for the evolution to live.’
‘I made the same decision in different words,’ Tomas said. ‘One entry per lesson. Not per week. Not per unit. Per lesson, because a lesson is the unit of thing I actually reuse.’
They compared the decision rule next, which turned out to be the most useful five minutes of the call.
‘How do you decide when something becomes a page instead of staying an entry,’ Priya asked.
‘Volume,’ Tomas said. ‘My rule is roughly ten. If a thing is going to accumulate more than about ten entries, it should be a page. Under ten, an entry with sections handles it and a page just adds a click.’ He shrugged. ‘It is crude and it has been right almost every time. A unit generates fifteen to twenty entries, so a unit is a page. A single lab generates one entry with five sections, so it is not.’
‘Mine is not volume, it is filtering,’ Priya said. ‘If I will ever need to look at that group in isolation, it is a page. If I will only ever encounter it inside something else, it is an entry.’ She thought for a second. ‘Which produces almost the same answer as yours most of the time, and diverges in an interesting place.’
‘Where?’
‘Small things I need to isolate. I have a sub-topic page with four entries under it, which by your rule should not exist. But it is the set of papers that disagree with each other about one mechanism, and I need to be able to look at exactly those four and nothing else, repeatedly, while I write that section. So it is a page despite being tiny.’
Tomas considered this.
‘I have the inverse and I never noticed it until you said that,’ he said. ‘I have units with twenty entries that are still one page and should probably be split, and I have not split them because they are never filtered separately. They are always used as a whole.’
‘So the rules combine.’
‘The rules combine into something better than either,’ he agreed. ‘Volume tells you when a page is getting unmanageable. Filtering tells you when a page is necessary regardless of size. I have been using half a rule for two years.’
‘I have been using the other half.’
What neither of them had got right on the first attempt was the shape itself, and both said so without embarrassment.
‘My first structure was chronological,’ Tomas said. ‘Year, then month, then day. It was extremely tidy and completely useless, because I do not think in dates. I think in units. A thing I taught in October two years ago is not related to anything else I taught in October. It is related to the same unit in every other year.’
‘How long did it take to work that out?’
‘About five weeks, and then a Saturday to fix it.’ He demonstrated: he dragged a page from one branch to another and the tree reflowed. ‘Drag and drop. Which is the feature that makes the whole thing survivable, because it means the first structure does not have to be right. I have restructured three times. Once from chronological to unit based, once when I picked up a second preparation, and once when I realised the department material had no business being mixed in with teaching.’
‘I have restructured twice and the second time was substantial,’ Priya said. ‘My chapters changed. Two of them merged and one split, which is normal for a doctorate and which would have been a catastrophe in a folder tree, because in a folder tree the reorganisation is a file move and every reference to those files breaks.’
‘Here it is a drag.’
‘Here it is a drag, and the entries keep their labels, keep their attachments, keep their sections, and keep their history.’ She used the page context menu to rename something as she spoke. ‘Rename, move, delete, all from the right click, which sounds trivial and is the difference between restructuring being a project and restructuring being a Tuesday evening.’
‘That is the thing I would tell somebody starting,’ Tomas said. ‘Do not try to design the correct hierarchy in advance. You cannot. Build something plausible, use it for a month, and then fix what annoys you. The annoyance is the information. The correct structure is discovered by running into the wrong one.’
The axis that runs the other way
‘Now the part where we probably disagree,’ Priya said. ‘Labels.’
‘I doubt we disagree. I suspect we use the same mechanism for different vocabularies.’
He showed his, which was short and had clearly been pruned. Safety. Lab. Homework. Exam prep. Robotics. Demo.
‘Six,’ Priya said. ‘That is disciplined.’
‘Six because every label I add makes the other five slightly less meaningful,’ Tomas said. ‘These are pedagogical categories rather than topical ones, and that is the important distinction. The page tree already knows what the content is about. Thermochemistry lives under Thermochemistry. What the tree cannot tell me is what kind of thing an entry is, and kind cuts straight across every course I teach.’
‘Show me it earning its keep.’
He cleared the page filter, selected the lab label, and the list filled with entries from four courses across six years.
‘Every lab activity I have ever run,’ he said. ‘Chemistry I, AP, both semesters, all six years, in one list. That view does not exist anywhere in the page tree and it is the view I use most in August when I am planning, because the question I am asking then is not what do I teach in unit four. It is which of my labs actually worked.’
‘And safety?’
‘Safety is the one I would keep if I could only keep one.’ He switched the filter. ‘Every entry involving a hazard, a chemical handling note, an incident, or a piece of equipment that needs supervision. Twenty six entries. When a new teacher joins the department, that filter is the induction, and it took me four seconds to produce.’
Priya’s vocabulary was longer and organized differently, and she said so before showing it.
‘Mine is a taxonomy rather than a set of categories, and it is bigger, and I have made peace with that because research vocabulary genuinely is bigger.’ She listed them. ‘Technique names, so anything involving a particular assay carries that assay’s label. Model organisms. Journal names for the handful I read constantly. One label per thesis chapter. And one that is not like the others, which I call key paper.’
‘Explain the last one.’
‘Thirty papers.’ She said it with some weight. ‘Out of eleven hundred. The thirty that a person entering my subfield would have to read to understand the conversation. That label is my answer to a question I get asked at every conference and could never answer well, and it is also the reading list I will hand to whoever inherits this project.’
Tomas sat back.
‘That is a wonderful use of a label and it is not a category at all,’ he said. ‘It is a judgment.’
‘It is a judgment made once per paper, at the moment I finish reading it, when I actually know.’ Priya nodded. ‘If I tried to construct that list from memory now it would be wrong and it would be biased toward whatever I read most recently. The label captures the assessment at the moment of maximum information.’
‘Say more about the chapter labels, because that is the one I do not have an equivalent for.’
‘That is the axis that makes the dissertation writeable.’ She applied one. ‘Every paper, every experiment, every protocol relevant to chapter three, regardless of where it sits in the page tree. Because the tree is organized by subject matter and the chapters are organized by argument, and those are not the same shape. A paper about a delivery mechanism might belong to two chapters and sit under a sub-topic that belongs to neither.’
‘So the label is the argument and the page is the subject.’
‘The label is the argument and the page is the subject, and I could not have said it that cleanly before you asked.’ She wrote something down. ‘When I sit down to write a section I filter to that chapter label and everything I need is in front of me, assembled from six different branches of a tree I built for a different purpose.’
Tomas asked about the mechanics of keeping a vocabulary that size honest, since his approach had been to keep it small.
‘Two things,’ Priya said. ‘The first is that I audit. Once a term I look at the label list with the counts beside it. A label on two entries is a mistake, either a note I should have written differently or a duplicate of something I already had. A label on four hundred entries is decoration and tells me nothing when I filter by it.’
‘And the second?’
‘Smart label suggestions, which I resisted for months and now rely on.’ She created a new entry to demonstrate, pasting in a paper abstract. ‘When I am adding a paper, it analyses the content and suggests labels from my existing vocabulary, with the counts on the chips so I can see how established each one is.’
‘Why did you resist?’
‘Because I assumed it would suggest new labels and I did not want a machine minting vocabulary,’ Priya said. ‘That is precisely what it does not do. It proposes from what I already have, which is the correct behaviour, because the failure mode of labelling at scale is not too few labels. It is fourteen near duplicates that should have been one.’
‘Give me the example.’
‘Lipid nanoparticle, lipid nanoparticles, LNP, and nanoparticle delivery.’ She counted them off with visible irritation at her past self. ‘I created all four across eighteen months because at each moment I could not remember exactly what I had used before. The suggestion chips show me the established one, and I pick it, and the vocabulary stops fragmenting. That is not a convenience feature. It is what keeps a taxonomy usable past a certain size.’
Tomas was already writing.
‘I am going to start using that,’ he said. ‘Not because my vocabulary is large. Because I have a second teacher joining my department in the spring and the moment two people label the same library, the near duplicate problem arrives immediately.’
The same five bars, on every entry of the same kind
‘Right,’ Tomas said. ‘Sections. This is the one I want to spend time on because it is the feature that moved this from a note application to something I would call a system, and I do not think most people find it.’
‘Agreed, and I found it late,’ Priya said. ‘Show me yours first.’
He opened a lesson entry, and beneath the body were five collapsed accordion bars.
‘Objectives. Materials. Procedure. Assessment. Reflection.’ He expanded them one at a time. ‘Every lesson entry I have has exactly those five, in that order, without exception, including the lessons that do not need all five, where the section exists and says so.’
‘Why keep an empty one?’
‘Because an empty Assessment section is information,’ Tomas said. ‘It tells me at a glance that this lesson does not check whether anybody learned anything, and about a third of my early lessons were like that, and I did not know until the template made the absence visible.’
Priya sat up slightly.
‘That is a strong argument for templates that I have not heard put that way.’
‘It is the entire argument, honestly.’ He scrolled through several entries and the same five bars appeared on each. ‘When every entry of a kind has the same internal shape, two things happen. The first is that I can compare, because the third bar down is always Procedure and my eye goes straight there. The second is that gaps become visible, and gaps are invisible in free-form notes. A blank space is not the same as a heading with nothing under it.’
‘And the attachments?’
‘Attached to the section they belong to.’ He expanded Materials and a handout sat inside it; he expanded Procedure and a lab sheet sat there instead. ‘The safety data sheet goes on Materials. The student handout goes on Procedure. The rubric goes on Assessment. Which means when I am standing in a classroom at eight in the morning looking for the rubric, I open one bar rather than scanning a pile of nine files attached to an entry with names I chose in a hurry two years ago.’
‘The clip indicator.’
‘Tells me which bars carry files without opening any of them, which is the thing I look at first.’
Priya shared hers, and the shape was different and the principle identical.
‘Paper entries have five,’ she said. ‘Summary. Methods. Key findings. Relevance to thesis. Commentary.’
‘Define the last two, because they sound similar and I suspect they are not.’
‘They are not remotely similar and keeping them apart is the most valuable discipline I have.’ She was definite about it. ‘Relevance to thesis is an argument about my own work. Does this support chapter three, does it complicate chapter five, do I need to address it. Commentary is my assessment of the paper on its own terms. Whether the sample size supports the claim. Whether the control is the right control. Whether I believe them.’
‘And if those were one section?’
‘Then I would write the version that is convenient for my thesis, which is exactly the failure that produces bad literature reviews,’ Priya said. ‘Separating them forces me to state my opinion of the work before I state what it does for me, and the order matters. I have several entries where the commentary is sceptical and the relevance is high, and those are the papers I have to handle most carefully in writing, and I would never have noticed the tension if the two assessments lived in one paragraph.’
Tomas whistled softly.
‘That is the research version of my empty Assessment section.’
‘It is the same mechanism exactly. The structure makes something visible that prose would have blurred.’ She opened another entry. ‘Experiments have a different template. Hypothesis, protocol, what actually happened, deviations, result, and what I would do differently. Six sections, and the fourth one is the one that took me two years to add.’
‘Deviations.’
‘What I actually did as opposed to what the protocol says.’ She said it wearily. ‘Every experimentalist knows this gap exists and almost nobody records it. The incubation that ran nineteen minutes instead of fifteen because a conversation happened. The reagent from a different lot. When an experiment fails to replicate six months later, the answer is nearly always in that section, and for two years that section did not exist and the answer was nowhere.’
‘So the failures are your most valuable entries.’
‘Three hundred runs, most of them failed, and the failures are the archive.’ Priya spread her hands. ‘A successful experiment produces a figure and the figure goes in a paper. A failed one produces knowledge about the system that exists nowhere else and is not published by anyone, ever, and it lives in my vault or it does not exist.’
They talked about what the template discipline costs, which was Tomas’s question.
‘Ninety seconds an entry,’ he said. ‘Roughly. Which sounds small and is the reason people do not do it, because ninety seconds at the end of a long day is the most expensive ninety seconds there is.’
‘How did you make yourself?’
‘I stopped treating it as filing and started treating it as the last step of the lesson.’ He shrugged. ‘The Reflection section is written while I put chairs on desks. Three sentences, what worked, what did not, what I would change. It is not documentation, it is thinking, and I would want to do it even if nobody ever read it.’
‘Mine is the same and it happens at the bench,’ Priya said. ‘The deviations section is written while the gel is running, because if I wait until I am back at my desk I will have already smoothed it into what the protocol said.’
Testing each other’s libraries in real time
‘I want to try something,’ Priya said, ‘and it may be unfair.’
‘Be unfair.’
‘I want to search your library and you search mine, and we watch what comes back, because I think the interesting thing about search here is not that it finds things. It is that it rewards the structure we have both just spent forty minutes describing.’
Tomas agreed and shared his screen. Priya gave him a query she considered genuinely hard.
‘Exothermic reaction real world application.’
‘This is a good test and you should know why,’ Tomas said as he typed it into the question search. ‘Because those exact words appear in almost nothing I have written. Nobody titles a lesson that.’
The results came back with three entries above a visible gap.
‘Hand warmers demonstration,’ he read. ‘Which is under thermochemistry in AP, from two years ago. Combustion and energy in food, which is Chemistry I, last spring, entirely different course. And a robotics entry about battery heat management, which is not chemistry at all and is exactly right, because the students asked me about it and I wrote down the explanation I gave them.’
‘That third one is what I wanted to see.’
‘That third one is a thing I had forgotten I owned,’ Tomas said. ‘And it came back because it is labelled demo and its body is full of language about heat release, not because anything in it is titled with your phrase.’
Priya asked him to look at the ordering, which he did.
‘The top one has the concept in the title,’ he said. ‘The second has it in labels and in the body. The third is body only. And that is the order.’
‘That is the weighting doing exactly what it should.’ Priya explained it as she watched. ‘Titles carry the most weight, then labels, then text pulled out of images inside an entry, then the body, then sections, then the main attachments and their names, then attachments hanging off a section. Which is not arbitrary. It reflects how specific a match is likely to be. If your phrase is in a title, the entry is about your phrase. If it is in an attachment, the entry merely contains it.’
‘Which means my titling habits are load bearing.’
‘Your titling habits are load bearing, and this is the part I would put in front of anybody starting,’ Priya said. ‘Structure is not tidiness. It is the input to retrieval quality. A well titled entry with accurate labels surfaces first, and a badly titled entry with no labels is at the mercy of whether your query happens to match its prose.’
They swapped. Priya shared, and Tomas gave her a query he could not evaluate and which she said afterward was better for exactly that reason.
She typed something long: CRISPR delivery lipid nanoparticle efficiency.
‘First result is the paper I was looking for,’ she said, ‘which is unsurprising because I knew it existed. Second is a review I labelled key paper. Third is,’ and she stopped.
‘Third is what?’
‘Third is an experiment log from fourteen months ago.’ She was reading it. ‘Which failed, and which I have not thought about since, and which failed for a reason that is directly relevant to something I am doing this week.’
There was a pause of the kind that only happens on video calls when one person has genuinely stopped participating.
‘I am going to need a minute,’ Priya said.
‘Take it. This is the best thing that has happened on this call.’
‘The deviations section says the incubation was extended,’ she said, mostly to herself. ‘And the thing I am optimising this week is incubation time. And I ran that experiment before I had a reason to care about incubation time, so I recorded the deviation as a nuisance rather than a variable.’ She looked up. ‘That is fourteen months of my own data telling me something I was about to spend three weeks discovering.’
‘And it came back third on a query about something else.’
‘It came back third because the language is in the body and the sections, which is lower weight, which is exactly correct.’ She was already starring it. ‘A shallower system would have shown me the two papers and stopped.’
They spent a while on the smaller search surfaces, which both used constantly and neither had thought about.
‘Typeahead is what I actually use forty times a day,’ Tomas said. ‘I start typing in the main search and suggestions appear as I go, across titles, bodies, labels, attachment names and content. Most of my retrieval never becomes a full search. I type four characters and the thing I want is in the dropdown.’
‘Same, and the one I underrated is query suggestions from history,’ Priya said. ‘It offers past queries as I type. Which sounds like a small convenience and is actually a record of what I keep needing to look up. Twice now I have looked at my own suggested queries and realised that a question I ask every week should have been an entry, or a label, or a page.’
‘Your search history as a design signal.’
‘A query I have run eleven times is a structure I have not built,’ Priya said. ‘That is a rule now.’
What the formatting is actually doing
‘Last technical thing,’ Tomas said, ‘and then I want to talk about why any of this matters, because I have a theory and you are the right person to test it on.’
‘Technical thing first.’
‘Tables.’ He opened an entry and there was one in the body, three columns, comparing reaction types across definition, energy change, and a real example. ‘This is not decoration and it is not a document I hand out. It is how I check my own understanding before I stand in front of thirty people, because a table forces the comparison to be complete. If a cell is empty, I do not know something.’
‘The empty section argument again.’
‘The same argument in a smaller container, yes.’ He grinned. ‘And the second use is lab data. Every lab entry has a results table in the procedure section with the values my classes actually produced, year over year. Which means when a student asks whether their number is reasonable, I have six years of what sixteen year olds actually get, and that is a better answer than the textbook value.’
Priya asked how he built them, and he demonstrated the size picker and then the context menu for inserting a column, which he said he used constantly because his tables always grew.
‘Mine are less interesting and my code blocks are the opposite,’ she said, and showed one. ‘Bioinformatics. Every analysis I run is a script, and the script goes in the entry with the experiment it produced, with a language label on the block so it is syntax marked and unmistakably code rather than prose.’
‘Why in the entry rather than in a repository?’
‘It is also in a repository,’ Priya said. ‘The repository has the code. The entry has the code that produced this figure, alongside the parameters I used and the reason I chose them and what the output looked like. Six months later the repository tells me what the script does. The entry tells me what I did with it, which is the question I actually have.’
‘And the callouts?’
‘Definitions and warnings.’ She scrolled and one appeared with its accent bar and title header. ‘Anything a reader of my own notes needs to have in mind before the surrounding paragraph makes sense. A term used non-standardly in a subfield. An assumption that only holds under certain conditions. I use them sparingly, maybe one or two per entry, because a page full of callouts is a page with no emphasis at all.’
‘I use them for a single purpose and it is not definitions,’ Tomas said. ‘Uncertainty. Anything in a plan I have not resolved. Whether this demonstration is safe with the ventilation in room 214. Whether the timing works with a shortened period. Before I teach the lesson I go through and every callout is either resolved into the plan or resolved into a decision not to do that part.’
‘So yours is a checklist and mine is a glossary.’
‘And both of them work because the block looks different from the paragraph around it.’
Headings came up, and they discovered they had converged on the same convention without discussion, which amused both of them.
‘Second level for major divisions within an entry, third level for subdivisions beneath those, and I never use the first level inside an entry because the entry has a title already,’ Priya said.
‘Identical,’ said Tomas. ‘And I arrived at it by making the mistake first. My early entries had a first level heading at the top repeating the title, which looked reasonable in the editor and looked absurd in the reading view.’
Colour was where they diverged, and the divergence was instructive.
‘Yellow highlight, one purpose only,’ Tomas said. ‘Safety. Anything that could hurt somebody. It appears in maybe four percent of my entries and when it appears my eye goes to it before I have read a word around it, and that is the entire design goal. I will not use yellow for anything else, ever, because the moment I highlight an interesting fact in the same colour, the warning stops being a warning.’
‘That is a discipline I do not have and should,’ Priya said. ‘Mine is red text for contradictory findings. When a paper reports something that conflicts with something else in my library, the conflicting claim goes in red in the commentary section, with the other paper named.’
‘Why red specifically?’
‘Because contradictions are the most important thing in a literature and the easiest to lose,’ she said. ‘You read a paper in March and a conflicting one in September and by December you remember both and you have unconsciously reconciled them into a story that neither of them supports. The red text is a flag that says do not smooth this over. When I write a section, I search visually for red.’
‘That is colour used as a data type.’
‘It is colour used as a data type, and it only works because I have exactly one meaning for it,’ Priya said. ‘The moment red also means important, it means nothing.’
Six years and eleven hundred papers, processed in the order they were needed
‘Practical question,’ Priya said. ‘Because everything we have described sounds wonderful and somebody reading it has four thousand files and no evenings.’
‘The backlog.’
‘The backlog. How did you actually do it, and be honest about how long it took.’
‘Two years, and I am not finished,’ Tomas said immediately. ‘And the reason I am not discouraged about that is that I stopped trying to finish.’
He explained the approach, which had taken him one failed attempt to arrive at. His first plan had been chronological: start at the oldest year and work forward. He had lasted eleven days.
‘It was demoralising and it was stupid,’ he said. ‘I was processing material from my first year, which is my worst material, and getting no benefit from any of it, because I was not teaching first year content that week. Pure cost, no return, which is a design nobody sustains.’
‘What replaced it?’
‘Need order.’ He said it like a slogan he had earned. ‘I process the unit I am about to teach. In late March I process thermochemistry, because I teach it in April. Which means the work always produces something I use within a fortnight.’
‘So the backlog gets processed at the rate of the school year.’
‘At the rate of the school year, which means a full pass takes a year, and by the end of that year every unit has been properly structured once, and the second pass is much faster because the shape already exists.’ He shrugged. ‘Slow, and it never feels like a chore, because I am not filing. I am preparing to teach and the filing is a side effect.’
Priya was writing.
‘Mine was the same discovery in different circumstances,’ she said. ‘I tried to process my whole reference library in one push before my second year review. I did four hundred papers in about three weeks and I want to tell you what happened to those four hundred entries.’
‘Nothing good, from your tone.’
‘They are the worst entries in my library.’ She was blunt about it. ‘Summary, methods, findings, all present, all technically accurate, all completely useless, because I was processing at volume rather than reading. I filled in boxes. I did not assess anything. And now I have four hundred entries that look complete and are not, which is worse than four hundred that look empty.’
‘Because you cannot see which ones need work.’
‘Because they look done,’ Priya said. ‘An empty section says come back to this. A filled section written mechanically says nothing at all. I would genuinely rather have left them blank.’
‘So what do you do now?’
‘Papers get processed when they become relevant to something I am writing.’ She held up a finger. ‘And I have a label for the ones from the bad batch, so when one of them surfaces I know to distrust its commentary and read the paper again. Which is the closest thing to a repair I have.’
Tomas laughed, and then asked about attachments, which he said was the part of his backlog he had underestimated most.
‘Six years of handouts, lab sheets, rubrics, slide decks, and photographs of whiteboards,’ he said. ‘Thousands of files. And my instinct was to sort them first and then attach them, which was another version of the same mistake.’
‘What worked?’
‘Attach as I process the entry, from wherever they happen to be.’ He demonstrated on a lesson entry: a handout attached to the procedure section, a rubric to assessment. ‘The file does not need to have been well named or well filed, because once it is attached to the right section of the right entry, its name has stopped mattering. It is findable by where it sits and by what is inside it.’
‘That last part is the one that changed my scanning,’ Priya said. ‘My lab notebooks are handwritten and they are scanned as images. Two full notebooks. And I had assumed those were essentially archival, a thing I keep for compliance and never actually read.’
‘And they are not.’
‘They are inline images inside the relevant experiment entries, and the text in them is read and indexed, so my own handwriting from three years ago turns up in searches.’ She said it with visible pleasure. ‘Not perfectly. My handwriting is not good. But well enough that a protocol number or a reagent name written in a margin makes that page findable, and that is the difference between an archive and a resource.’
‘Give me the rule you would tell somebody,’ Tomas said. ‘One sentence.’
Priya thought about it.
‘Process in the order you need things, never in the order they were created,’ she said. ‘Because the first order gives you a return every session and the second gives you a return in two years, and nobody works for two years on faith.’
‘Mine is close,’ Tomas said. ‘Never process anything you are not about to use. If I cannot name what I will do with an entry this month, I leave it, and the tree has an unstructured branch at the bottom called Not yet, which currently holds about nine hundred files and which I have stopped feeling guilty about.’
‘You have a page for the backlog.’
‘I have a page for the backlog, and putting it in the tree rather than leaving it outside was the thing that stopped it being a source of low-grade dread,’ he said. ‘It is not mess any more. It is a queue.’
Why arranging the thing teaches you the thing
‘Now my theory,’ Tomas said.
‘Go.’
‘I do not think the value of this is retrieval.’ He said it slowly, as somebody testing an idea rather than delivering one. ‘I mean, retrieval is the obvious benefit and it is real and it saves me hours. But the thing that actually changed my teaching is not that I can find the old lesson. It is that breaking a lesson into objectives, materials, procedure, assessment and reflection forced me to notice that a third of my lessons had no coherent arc.’
Priya did not answer immediately.
‘I have the same experience and I have been calling it something else,’ she said. ‘I have been calling it processing. Reading a paper and highlighting it is passive. Reading a paper and being obliged to state, in separate compartments, what they did, what they found, whether I believe them, and what it means for my argument, is a different cognitive activity entirely. It is the difference between reading and assessing.’
‘So the template is not a container.’
‘The template is a set of questions,’ Priya said. ‘Which is why the empty sections matter so much. An empty box is a question I did not answer, and a document with no boxes lets me not notice that I did not answer it.’
‘I want to say the uncomfortable version,’ Tomas said. ‘I was a worse teacher than I thought I was, and the structure is how I found out. Six years of lesson plans, arranged consistently for the first time, and the pattern was visible in an afternoon. Strong on content, strong on activity, weak on checking whether anyone learned anything.’
‘Would anyone have told you?’
‘My evaluations were fine. Observations were fine.’ He shrugged. ‘Nobody looks at six years of a teacher’s material at once. Nobody has any reason to. The only person positioned to see the pattern is me, and I could only see it once the material was in a shape where a pattern could be visible.’
‘I will give you mine,’ Priya said. ‘I discovered that a chapter of my thesis was resting on four papers that share a methodological weakness, and I discovered it because all four had scepticism in their commentary sections and high relevance in their relevance sections, and when I filtered by that chapter label I saw the four of them together for the first time.’
‘What did you do?’
‘I redesigned an experiment, and it is now the strongest part of the chapter.’ She smiled slightly. ‘That is a structural discovery. No amount of rereading those four papers individually would have produced it, because individually each one is fine. The problem was only visible as a set, and the set only existed because I had labelled by argument rather than only by subject.’
They exchanged commitments at the end, in the slightly formal way that people do when they intend to actually follow through.
‘I am going to standardise my templates properly,’ Priya said. ‘I have three types of entry and only one of them has a real template. Experiments and protocols have grown organically and I am going to fix that this month.’
‘I am going to turn on the label suggestions and start using them before the new teacher arrives,’ Tomas said. ‘And I am going to steal your key paper idea entirely. Twenty lessons that a new chemistry teacher would need. Not my best twenty. The twenty that carry the year.’
‘Send me the list when you have it.’
‘Send me your deviations template. I want to see whether it maps onto lab practicals, because I have the identical problem and I have never named it. What I actually did versus what the lab sheet says.’
Priya laughed.
‘Sixteen year olds and doctoral students,’ she said. ‘Identical failure mode.’
Structure is not filing
The most useful thing to take from that conversation is that two people separated by six thousand miles, twenty years of career stage, and entirely different subject matter produced the same architecture, and that the convergence was not a coincidence about software. It was a convergence about the shape of the problem.
Both built a hierarchy on the entities that do not change: courses, semesters, and units in one case, thesis chapters and sub-topics in the other. Both discovered that the first hierarchy was wrong and that being able to rearrange it by dragging was what made the wrongness survivable, because the correct structure is found by running into the incorrect one rather than by designing it in advance. Both settled on a leaf entry with a stable identity, one lesson or one paper, on the grounds that anything without its own identity cannot be labelled, cannot accumulate an evolving opinion, and cannot be reached. And both arrived at complementary rules for when something becomes a page: volume, because a page that grows past a certain size stops being scannable, and independent filtering, because a group that must be examined in isolation needs to exist as a group regardless of how small it is.
Both then discovered that a hierarchy alone is insufficient, because every domain contains categories that run perpendicular to its tree. Labels supply that second axis, and the interesting observation is how differently they were used while performing an identical function. A teacher’s labels described what kind of thing an entry was, since the tree already described what it was about. A researcher’s labels described technique, organism, journal, and argument, with one label reserved for a judgment rather than a category: the thirty papers out of eleven hundred that someone entering the field would have to read. In both cases the label answered a question the tree structurally could not, and in both cases keeping the vocabulary honest, by auditing counts and by choosing from established labels rather than minting new ones, was what kept it usable at scale.
The deeper layer, and the one both described as the thing that changed their practice rather than merely their filing, was internal structure. Standardized sections turn a collection of notes into something comparable. When every lesson entry carries objectives, materials, procedure, assessment, and reflection, and every paper entry carries summary, methods, findings, relevance, and commentary, the collection becomes queryable by eye: the reader knows where to look, comparisons across entries become possible, and, most importantly, gaps become visible. An empty section is a question that was not answered, and prose does not have empty sections. It simply omits, silently.
Search then repays all of it. A weighted system that ranks a match in a title above a match in labels, and labels above extracted image text, body, sections, and attachments, is a system in which the effort spent on titling and labelling converts directly into retrieval quality. That is why structure and search are not alternatives. Good structure is the input that makes search precise, and search is what makes the structure worth having built. The demonstration that matters is not finding the document you were looking for; it is the third result, the forgotten experiment or the entry from an unrelated course, which surfaced because its body and sections carried the right language and which changed what somebody did that week.
Which leaves the observation that neither of them expected to be making. The retrieval is the visible benefit and it is not the largest one. Arranging knowledge is itself an act of understanding it. Deciding which section a paragraph belongs in requires knowing what that paragraph is. Filling in a template requires answering questions that unstructured writing allows a person to skip. Both of them found something uncomfortable about their own work, a pattern of lessons that taught without checking and a chapter resting on four papers with a shared weakness, and in both cases the finding was only possible because the material had been arranged into a shape where a pattern could become visible. Nobody else was ever going to look at six years of lesson plans or eleven hundred paper summaries. The only person positioned to see it was the person who wrote it, and only after they had built the structure that let them look.
FAQs
Why is search alone insufficient for a large body of personal notes?
Full-text search answers only the questions that can be phrased in whatever vocabulary a document happened to use, which is a genuine capability and a limited one. It cannot express that a lesson plan, a safety sheet, and a set of results belong to the same teaching unit, or that four papers out of eleven hundred are the ones a newcomer must read, or that a mention in passing differs from a central treatment. Search retrieves strings while structure retrieves meaning, and the two are complementary. In practice, well-structured material also produces dramatically better search results, because the ranking system has something meaningful to weight.
Can structure be added to years of existing notes, or is it too late?
It can be added retroactively, and this is the most encouraging property of the whole problem. Content that was never written down is genuinely lost, but content that was written and filed badly is merely unaddressed, and addressing is work that can be done later by anyone willing to spend a number of evenings on it. The material usually becomes more valuable in the process rather than simply more findable, because deciding where something belongs requires establishing what it actually is. Most people report that the retroactive pass produces insights about their own work that they did not expect. The one caveat is that the work should be done attentively rather than at volume, since a mechanically processed backlog produces entries that look finished and are not.
How should a hierarchy be organized for teaching material?
The reliable pattern places the stable entities at the top and works downward: course, then semester, then unit, then entries for individual lessons, labs, and assessments. Anything belonging to the course as a whole rather than to a unit stays at the course level. Non-teaching material such as departmental business belongs in its own top-level branch rather than mixed into the courses. Page icons and colour dots help more than they appear to, since a person opening the sidebar early in the morning is pattern matching rather than reading, and colour reaches the correct branch measurably faster than text. Keeping department business, professional development, and other non-teaching material in its own top-level branch prevents the course tree from filling with items that never belong to a lesson.
How should a hierarchy be organized for doctoral research?
A common and effective arrangement puts the thesis at the top, chapters beneath it named by working title rather than by number, sub-topics beneath the chapters reflecting the real conceptual divisions, and entries at the leaves. Naming chapters rather than numbering them matters because numbers change during a doctorate and names generally do not. Entries should be one per paper, one per experiment, and one per protocol, so that each has an identity capable of carrying labels, attachments, and an opinion that evolves over several years of work. Sub-topic pages should follow the real conceptual divisions of a chapter rather than mirroring any external taxonomy, since the point is to support the argument being written. Naming everything by working title also means the tree stays readable when chapters are reordered.
When should something be a page rather than an entry?
Two rules combine well. The volume rule says that anything expected to accumulate more than roughly ten entries should be a page, since beyond that an entry with sections stops being scannable. The filtering rule says that any group which will need to be examined in isolation should be a page regardless of its size, because a group that must be viewed alone needs to exist as a group. Volume identifies pages that are becoming unmanageable; filtering identifies pages that are necessary even when tiny. Using only one of the two leaves a predictable category of mistakes. Applying both rules together also makes restructuring decisions easy later, since a page that has outgrown scanning and a group that is never filtered alone are both immediately identifiable.
What if the initial structure turns out to be wrong?
It will be, and planning for that is more productive than trying to avoid it. Pages support drag-and-drop reordering and a context menu for renaming, moving, and deleting, so restructuring is an evening rather than a project. Entries retain their labels, attachments, sections, and history through a move, which is the critical difference from a folder tree where reorganisation breaks references. The practical advice is to build something plausible, use it for a month, and then fix whatever has become annoying, because the annoyance is the signal and the correct shape is discovered by encountering the incorrect one. Most people restructure two or three times over the first couple of years, and those revisions are a sign the structure is being used rather than evidence that the original plan failed.
Why do labels work as a second organizing axis?
Because every domain contains categories that run perpendicular to its hierarchy, and forcing them into the tree produces either duplication or distortion. A page tree organized by subject cannot express what kind of thing an entry is, and a tree organized by chapter cannot express what technique an experiment used. Labels answer those questions across the entire structure at once, which is why filtering by a single label frequently produces a view that exists nowhere in the hierarchy. The most useful label sets describe a dimension the tree deliberately does not encode. A useful test when adding one is whether the tree could already answer the question; if it could, the label is redundant, and if it could not, the label is probably worth having.
What makes a good label vocabulary for a teacher?
Short, and describing kind rather than topic. A working set covering safety, lab, homework, exam preparation, and a small number of programme-specific categories tends to be sufficient, because the page tree already carries the subject matter. Each additional label slightly reduces the meaningfulness of the others, since a larger vocabulary is assigned less carefully. The highest-value single label is usually safety: filtering by it produces every entry involving a hazard, a chemical handling note, or supervised equipment across all courses and years, which doubles as induction material for a new colleague. Keeping the set under roughly eight also means every label can be held in mind while writing, which is what keeps assignment consistent across years and across colleagues.
What makes a good label vocabulary for a researcher?
Larger, because research vocabulary genuinely is larger, and organized as a taxonomy rather than as a small set of categories. Technique names, model organisms, a handful of frequently read journals, and one label per thesis chapter cover most needs. The chapter labels deserve particular attention because they encode argument rather than subject, and the argument does not have the same shape as the subject matter tree. Filtering by a chapter label assembles every paper, experiment, and protocol relevant to a section of the dissertation from branches built for a different purpose. Because these vocabularies grow naturally with the field, periodic pruning matters more here than in a smaller set, and suggestions drawn from established labels do most of the work of preventing fragmentation.
What is a judgment label and why is it valuable?
It is a label that records an assessment rather than a category, the clearest example being one marking the small number of papers that anybody entering a subfield would have to read. Its value comes from being applied at the moment of maximum information, immediately after reading, when the reader actually knows what they think. Reconstructing such a list from memory years later produces something biased toward whatever was read most recently. It also becomes the reading list handed to a successor, which makes it one of the more durable artifacts a long project produces. The same pattern works outside research: a teacher might mark the small number of lessons that carry a course, which is both a planning aid and an induction resource for a new colleague.
How does a label vocabulary stay usable as it grows?
Through periodic auditing and through choosing from established labels rather than inventing new ones. Reviewing the label list with counts beside it once a term identifies both failure modes: a label on two entries is usually a mistake or a duplicate of something that already existed, and a label on several hundred entries has become decoration that conveys nothing when filtered. The dominant problem at scale is not too few labels but near duplicates that should have been one, created because the author could not recall the exact wording used previously. Merging near duplicates when they are found is straightforward and worth doing immediately, since each additional variant makes the next one more likely by obscuring what already exists.
What do smart label suggestions actually do?
When an entry is being edited, the content is analysed and labels are proposed from the vocabulary that already exists, presented as suggestion chips with counts showing how established each one is. The important behaviour is that suggestions are drawn from existing labels rather than inventing new vocabulary, which addresses the fragmentation problem directly. Someone adding a paper sees the established form of a term and selects it instead of creating a fourth variant. This becomes more valuable as a library grows, and considerably more valuable as soon as more than one person is contributing to it. They also shorten the labelling step enough that it actually happens, which matters because labels applied inconsistently at the moment of creation are rarely repaired afterward.
Why do standardized sections matter more than free-form notes?
Because consistency makes a collection comparable and makes gaps visible. When every entry of a given type carries the same sections in the same order, the reader’s eye goes straight to the relevant part, comparisons across entries become possible, and an empty section states plainly that a question was not answered. Free-form prose does not have empty sections; it omits silently, so absences are invisible. Many people report that the template revealed a systematic gap in their own practice, which is a finding available only once the material has a shape in which patterns can appear. They also make an entry legible to somebody else, which becomes relevant the moment a colleague, a successor, or a collaborator has to work from the same material.
What section template works for lesson plans?
A widely used arrangement is objectives, materials, procedure, assessment, and reflection, applied to every lesson entry without exception, including lessons where a section is left empty. The empty section carries information: an unfilled assessment section states that the lesson does not check whether anyone learned anything. Attachments belong to the section they relate to rather than to the entry as a whole, so a safety data sheet sits under materials, a student handout under procedure, and a rubric under assessment, which makes locating a specific file a matter of opening one bar rather than scanning a list. Applying it to every lesson without exception is what preserves the comparison, since a template used only when convenient stops being a reliable indicator of anything.
What section template works for research papers?
Summary, methods, key findings, relevance to thesis, and commentary is a strong default, and the final two should stay separate rather than being merged. Relevance is an argument about the reader’s own work, while commentary is an assessment of the paper on its own terms, including whether the sample supports the claim and whether the controls are appropriate. Keeping them apart forces an opinion of the work to be stated before its usefulness is considered, which is exactly the discipline that prevents convenient readings from quietly shaping a literature review. Writing the commentary before the relevance, rather than merely storing them separately, is the version of this discipline that produces the most honest assessments.
What should an experiment entry contain?
Hypothesis, protocol, what actually happened, deviations, result, and what to do differently covers most experimental work. The deviations section is the one most often missing and most valuable: it records what was actually done as opposed to what the protocol specified, including extended incubations, substituted reagent lots, and interruptions. When something fails to replicate months later, the explanation is usually in that section. Since most experimental runs fail and failures are rarely published anywhere, this material exists only in the researcher’s own records or nowhere at all. Writing the deviations while the work is still running, rather than at the desk afterward, is what keeps the record accurate, since memory smooths an account toward what the protocol specified. That single habit accounts for much of the value of the whole template.
How much time does maintaining templates actually cost?
Roughly ninety seconds per entry, which is small in aggregate and expensive at the moment it is due, since it falls at the end of an already long day. The practitioners who sustain it describe reframing the work as the final step of the activity rather than as filing. A reflection written while tidying a classroom, or a deviations note written while an experiment is still running, is thinking rather than documentation, and it captures detail accurately because it happens before memory has smoothed the account into what was supposed to occur. The cost also falls over time, because a familiar template becomes something a person completes without deliberation rather than a form they have to think their way through.
How does search weighting reward good structure?
Matches are weighted by how specific they are likely to be: titles carry the most weight, then labels, then text extracted from images inside an entry, then the body, then sections, then main attachments and their names, then attachments belonging to a section. A phrase in a title suggests the entry is about that phrase, while a phrase in an attachment means the entry merely contains it. The practical consequence is that titling and labelling habits convert directly into retrieval quality, and that a carefully structured entry surfaces ahead of an unstructured one containing the same words. It also means improving titles across an existing library is one of the highest-return retroactive changes available, since it lifts every future query at once.
Why are lower-ranked results worth reading?
Because they are frequently where the unexpected value sits. Results matching only in the body or in sections rank below title and label matches, which is correct, and those lower positions are often occupied by material the searcher had forgotten owning. A researcher looking for a specific paper may find a forgotten experiment log three positions down whose failure explains something they are working on that week. A teacher searching a chemistry concept may surface a robotics entry written in answer to a student question. Neither would appear in a system that stopped at strong matches. Scanning past the obvious matches costs a few seconds and is where the most useful surprises in a mature library tend to appear.
What are typeahead search and query suggestions used for?
Typeahead produces suggestions in a dropdown as a query is typed, covering titles, bodies, labels, attachment names, and attachment content, and it handles a large share of everyday retrieval before a full search is ever run. Query suggestions from history offer previously used queries, which is a convenience and also a diagnostic. A question asked repeatedly indicates a structure that has not been built: a query run eleven times is usually a label, a page, or an entry that should exist, and reviewing suggested queries periodically is a cheap way to find those gaps. Together they cover most everyday retrieval, which means the full search surface is reserved for genuinely difficult questions rather than routine lookups.
How are tables useful in educational and research notes?
Tables force comparisons to be complete, which is why they function as a check on the author’s own understanding rather than merely as a presentation device: an empty cell marks something the writer does not know. A comparison table across categories exposes gaps in a way that prose does not. A results table accumulating values across several years of the same laboratory exercise provides a realistic reference for what students actually obtain, which answers questions about plausibility better than a textbook figure. The size picker and the context menu for inserting rows and columns support tables that grow over time. Because tables tend to grow as understanding develops, the ability to insert rows and columns from a context menu matters more than it appears to when the first version is created.
Why keep analysis code inside a note as well as in a repository?
Because the two answer different questions. A repository holds what a script does and how it has changed. An entry holds the code that produced a specific figure, together with the parameters chosen, the reasoning behind those choices, and what the output looked like, which is what a researcher actually needs when revisiting a result months afterward. Code blocks carry a language label so the content is clearly marked as code rather than prose, which matters in an entry that otherwise contains narrative text and observations. Language labels on the block also make an entry readable at a glance, since code and narrative are visually distinguished rather than running together in one undifferentiated body of text. The two locations serve different questions and neither replaces the other.
What are callout blocks best used for?
Two patterns dominate and both work because the block is visually distinct from surrounding text. The first is definitional: terms used non-standardly in a subfield, or assumptions that hold only under particular conditions, placed where a reader needs them before the following paragraph makes sense. The second is uncertainty: unresolved questions in a plan, which are swept before the work is carried out and either resolved into the text or resolved into a decision to omit that part. Using them sparingly is essential, since a page full of callouts contains no emphasis at all. Whichever pattern is adopted, using one meaning consistently is what preserves the signal, exactly as with colour or with any other visual convention.
How should heading levels be used inside an entry?
Second-level headings for major divisions and third-level for subdivisions beneath them is the convention most people converge on, with the first level avoided inside an entry because the entry already has a title. A first-level heading repeating the title looks reasonable while editing and looks redundant in the reading view. Consistent heading use also improves navigation within long entries and makes structure legible at a glance, which matters most for entries that grow over months rather than being written once. Long entries benefit most, since consistent heading levels are what allow structure to be understood without reading the content beneath them. Establishing the convention early avoids a tedious cleanup pass later.
How should colour and highlighting be used?
With exactly one meaning per colour, which is what makes the signal work. A teacher who reserves yellow highlight solely for safety information will notice it before reading anything around it, and that effect disappears the moment yellow also marks interesting facts. A researcher who uses red text only for findings that contradict something else in the library gains a visual index of the tensions in a literature, which are the easiest things to lose and the most important to preserve. Colour used as a data type is powerful; colour used for general emphasis conveys nothing. Deciding the meaning once, writing it down, and refusing to reuse the colour for anything else is the whole discipline, and it fails the first time an exception is permitted.
Does structuring knowledge actually improve the underlying work?
Consistently, and both teachers and researchers describe it as the larger benefit. A template is effectively a set of questions, so filling one in requires answering things that unstructured writing permits a person to skip. Deciding which section a passage belongs in requires establishing what that passage actually is. Practitioners frequently discover systematic patterns in their own practice this way, such as lessons that deliver content without checking learning, or a group of sources sharing a methodological weakness. Nobody else reviews years of one person’s material, so these findings are available only to the author, and only after the arrangement exists. The effect appears to come from the questions the structure imposes rather than from the arrangement itself, which is why templates repay more than a well-designed folder tree ever could.
What is the best way to start if the backlog feels overwhelming?
Begin with the structure rather than the files, since deciding the shape is the actual work and material tends to fall into place once there is somewhere obvious for it to go. Establish the top two levels of the hierarchy, define a template for the most common entry type, and choose a small label set. Then process material in the order it is needed rather than chronologically, so that each session produces something immediately useful. Accepting that the first structure will be revised removes most of the paralysis, since a decision that can be dragged into a different position later does not need to be correct now.
In what order should a backlog be processed?
In the order material is needed rather than the order it was created. Chronological processing produces no usable return for a long time, which is why almost nobody sustains it past the first fortnight. Processing the unit about to be taught, or the papers relevant to the section currently being written, means every session yields something used within days. A full pass then completes at the natural rhythm of the work, a school year or a thesis chapter, and the second pass is considerably faster because the shape already exists and only the content needs revisiting. The approach also removes the psychological burden of a deadline, since there is no point at which the backlog must be finished for the work to be worthwhile.
What goes wrong when a backlog is processed in bulk?
The entries look complete and are not, which is worse than leaving them untouched. Working at volume produces mechanically filled sections: a summary that restates the abstract, findings copied rather than assessed, commentary that says nothing. Because the entry appears finished, there is no signal indicating that it needs attention, whereas an empty section plainly says come back to this. Practitioners who have done a bulk pass often flag those entries with a label so that anything surfacing from that batch is treated with appropriate suspicion until it has been properly reworked. The lesson generalises: an entry is worth creating only when there is enough attention available to answer the questions its template asks.
Is it acceptable to leave part of the archive unstructured?
Entirely, and giving the unprocessed material an explicit home in the hierarchy works better than leaving it outside the system. A branch holding everything not yet processed converts an amorphous source of guilt into a visible queue with a known size. Files there remain searchable by content, so nothing is unreachable, and they can be pulled into proper structure at the moment they become relevant. The useful discipline is to avoid processing anything without a specific near-term use, since work done without a use rarely gets done well. Naming that branch plainly, so its purpose is obvious to anyone who opens the sidebar, also prevents it from quietly becoming a permanent dumping ground.
How should attachments be handled during a migration?
Attach them while processing the entry they belong to, taken from wherever they currently sit, rather than sorting the files first. Once a file is attached to the correct section of the correct entry, its filename stops carrying any organizational burden, because it is now findable by position and by content. Sorting files before attaching them repeats the original mistake at a smaller scale and adds a step that produces no benefit. Attaching to the specific section rather than the entry as a whole is what makes retrieval fast later. Because extracted text from attachments participates in search, even a poorly named file becomes reachable through its contents once it has been brought into the vault.
Can handwritten notebooks become part of a searchable system?
Yes, and the result is usually better than expected. Scanned pages placed as inline images inside the relevant entries have their text extracted and indexed, so handwritten content participates in searches alongside typed material. Accuracy depends on legibility and will not be perfect, but partial extraction is generally sufficient, since the objective is findability rather than transcription. A protocol number, a reagent name, or a date written in a margin is often enough to make the page reachable, which converts a compliance archive into a working resource. Placing scans inside the entry they document, rather than in a separate archive branch, is what makes them turn up in ordinary searches rather than requiring a deliberate visit.
How do two people share one structured library without degrading it?
Agreeing the conventions before the second contributor starts prevents most of the drift, since naming and labelling inconsistencies compound quickly. The label vocabulary needs particular attention, because near-duplicate labels appear almost immediately once more than one person is assigning them, and choosing from established labels rather than inventing new ones is the mechanism that keeps this in check. Templates help as well: when both contributors use the same sections for the same type of entry, material produced by either remains comparable and gaps remain visible. Writing the conventions down as an entry in the vault itself is the simplest way to keep them available, and it doubles as onboarding material for anyone who joins later.
What is the value of standardizing templates across entry types?
It makes a collection comparable by eye and makes absences legible. A reader who knows the third section is always procedure goes there directly, and differences between entries of the same type become obvious rather than requiring careful reading. Templates also act as a set of questions, so producing an entry requires answering things that free-form writing allows a person to skip. Most people find that at least one template reveals a systematic weakness in their own practice, which is a finding available only once the material has a consistent shape. Different entry types should have different templates, and the discipline is consistency within a type rather than uniformity across all of them.
Do sections change how attachments are found?
Substantially, because the attachment inherits the meaning of the section it sits in. An entry with nine files attached at the top level requires scanning a list of names chosen in a hurry, while the same nine distributed across the sections they belong to require opening one accordion bar. Clip count indicators show which sections carry files without any bar being expanded, so locating a specific document becomes a matter of knowing what kind of thing it is rather than remembering what it was called. The same principle helps when several files are genuinely similar, since the section they sit in distinguishes a rubric from a handout without either being renamed.
How can search history reveal missing structure?
Query suggestions drawn from past searches double as a record of what a person repeatedly needs. A question asked many times is usually a structure that has not been built: a filter that should be a label, a group that should be a page, or a summary that should be an entry. Reviewing suggested queries occasionally is a low-effort way to identify those gaps, since the repetition itself is the evidence. Converting a frequently repeated query into a permanent piece of structure removes the search from daily work entirely. It is worth checking every few months, since the pattern only becomes visible once a query has been repeated enough times to stand out from ordinary use.
Does building structure ever reveal uncomfortable things about one’s own work?
Frequently, and practitioners generally describe those findings as the most valuable outcome. Arranged consistently, six years of teaching material can reveal a systematic pattern such as lessons that deliver content without checking learning. A labelled research library can reveal that several sources supporting one argument share a methodological weakness, which is invisible when each is read individually. Nobody else reviews years of one person’s material, so the author is the only party positioned to notice, and only after the arrangement makes the pattern visible. The findings tend to be actionable rather than merely dispiriting, since a pattern visible across years is usually one a person can correct deliberately going forward.
Does this approach work for subjects outside science and teaching?
The architecture transfers directly, because the underlying requirements are not domain specific. Any field producing accumulated material over years faces the same three needs: a hierarchy built on entities that do not change, a second axis for categories running perpendicular to that hierarchy, and internal structure that turns each item into something comparable with others of its type. The vocabulary differs entirely between a legal practice, a design studio, and a parish office, while the shape does not. What varies most is the template, since the questions worth imposing on an item depend on what that item is. A useful starting move in any field is to ask which entities will still exist in a decade, since those are the ones that should carry the hierarchy.
How long before a newly structured library starts paying off?
Sooner than most people expect, because the return begins with the first properly processed section rather than at the end of a migration. Someone processing the unit they are about to teach or the papers relevant to what they are writing gets value within days. The larger effects, the ability to compare across years and to notice patterns in one’s own practice, arrive once a meaningful portion of one type of entry shares a template, which usually takes a few months of ordinary work rather than a dedicated project. Choosing a single entry type and applying its template consistently is the fastest route to that second stage, since comparison requires a set rather than an example.
What is the most common mistake when building a structure like this?
Attempting to design the correct hierarchy before using it. The correct shape is discovered by encountering the wrong one, since the annoyances produced by a poor arrangement are precisely the information needed to fix it. The second most common mistake is a label vocabulary that grows without auditing, which fragments into near duplicates and gradually stops filtering anything usefully. Both are recoverable, which is the point worth emphasising: pages can be dragged, labels can be merged, and templates can be applied retroactively to entries that already exist. Treating the first arrangement as provisional from the outset removes most of the pressure, and it tends to produce a better structure faster than careful advance planning does.