Skip to main content

Multimedia Knowledge Representation and Management : "Brain Annex"

 (Updated Feb. 2022)

Wouldn't it be fantastic to have a "butler" to help us as we constantly face drowning in information?

That need was crushingly pressing for me, as a polymath with a thirst for knowledge in several fields, not to mention numerous very technical jobs over the years, several complex research projects, old notes from college and grad school, an endless stream of online courses I take, a tech startup I founded and used to run, the many conferences I attend, life in general, and even hobbies that tend to generate abundant information (such as flying airplanes and studying multiple foreign languages!)  

I was immensely eager for some sort of powerful assistance, something so helpful that I could poetically describe as an "annex" to my brain..

In this blog entry, I'll describe how deep frustration with existing software tools led to the start of the open-source project, a web-based knowledge representation and management application.

The Problem

Knowledge comes in many forms.  Notes written out in words.  Tabular data.  Semi-structured data.  Images.  Plots.  Documents.  Audio.  Video.  Meta-data about other bits of knowledge.  Relationships between different notes....

Word processors are great to typeset your novel, but of mediocre help for structured or semi-structured data, such as the many little ideas about tidbits to include in the novel.  And they are unwieldy about managing images, never mind other types of knowledge.

Likewise, spreadsheets are as sleek as a penguin in water for the specific tasks they were designed for, but as clumsy as a penguin wobbling on land if used in other ways!

And traditional relational databases tend to require more expertise, beyond casual users; that's not a problem for me personally - in fact I worked as a database administrator for years - but databases can be rather unwieldy.

We've all been there, in our personal data management, and at work : we end up generating a lot of files - in particular Word docs, spreadsheets and images - and resort to using the file system to try to "tame" them in some fashion.  A battle easily lost, as evidenced by how many files typically end up littering the computer desktop.

Also, the OS file system is most definitely not meant to be a content management system.  In particular, the tree structure forces to choose one - and one only - location for a file or folder.  If you want multiple parents (categories) for a file or folder, you need to resort to creating very unwieldy "shortcuts" (or their counterparts in various operating systems), which are generally "second-class citizens"; for example, in Windows, shortcut folders are listed alphabetically after all the "regular" folders.

Beyond Content Management Systems

Content Management Systems are not a new idea.  But they are often specialized; for example, I worked with - and also developed - some Lab Information Management System (LIMS.)

Many of the more general-purpose content management systems aren't particularly popular - for good reasons, in my opinion.  I will contrast-and-compare some in future blog entries, but for now I'll just say that my jaw dropped when I tried out Microsoft One Note!  Not particularly useful - other than for laughs - and so no surprise that it never really took off, even with MS behind it...

Then, in 2015, after years of dissatisfaction with existing knowledge-management tools, I took the software platform that I had developed over the previous decade for a fairly elaborate movie information management system, and decided to apply it towards creating a general knowledge representation and management tool, to be eventually released as open source.

That's how the project was born.

What is Brain Annex?

 Brain Annex is a web-based tool (which can also run locally) for Knowledge and Media Management.  It's very integrative, bringing in several open-source tools, and it's highly extendable with plugins.

There is no point to repeat here what's said on the official  site, but I'll just mention one blurb:
Freely mix up formatted text notes, documents, images, graphics, data tables, spreadsheets, video, music – synergistically used together with the power of Semantic Technology. For example, to manage:
  • class notes
  • work/research notes
  • notes from hobbies
  • notes from everyday life (bills, medical)
  • personal-growth notes (journaling, progress)
  • music collection
  • photo/video collection (personal, work or research albums; artist porfolios)
  • website bookmarks (with optional annotations)
  • documents (the contents of any uploaded PDF files become searchable)
  • new plugins for special needs can be created easily
  • optionally sharing some of of your pages with others or making them public

Here's a 3-min intro video, aimed at the general public and casual users:


Above All, Something that is Useful

In various blog entries I'll be talking about interesting designs and technology behind knowledge representation and management, but the first-and-foremost force behind Brain Annex has been to create something extremely useful.  Remember the "butler" analogy I made at the beginning?  Brain Annex isn't meant to be a show-off for technology, or a playground for programmers; it's meant to be something of practical utility!

Since this is a blog about Science and Technology, the focus will be on the technologies behind Brain Annex - for example, Semantic Technology and Classes that have code (plugins) associated to them.  For more practical information about Brain Annex, including what it does and how to use it, I'll refer to the official  site.

I am happy to say that, without exaggeration, Brain Annex has been a life-changer for me, in terms of managing my knowledge - for my research projects, jobs, courses, hobbies, and life in general.  I've used it essentially daily for the past 6 years.  Down the line, the plan is to release it as open source (UPDATE: done, see below), and hopefully help out others.


Feb. 2021 UPDATE: a radically-revamped new major version of Brain Annex is currently under development, and is expected later this year.  It keeps the same general feel while overhauling and modernizing the technology internally used: PHP gives way to Python/Flask, and MySQL and a simple Triplestore give way to the graph database Neo4j.  Also, the front end is getting a major face life with Vue.js  .  Management of general datasets will be much more powerful.  The promised full release to open source will happen with this version.

Feb. 2022 UPDATE: the release of the complete redesign of Brain Annex - now in beta - took place as promised last year.  GitHub repository.


Popular posts from this blog

Graph Databases (Neo4j) - a revolution in modeling the real world!

(UPDATED 9/2022) - I was "married" to Relational Databases for many years... and it was a good "relationship" full of love and productivity - but SOMETHING WAS MISSING! Let me backtrack.   In college, I got a hint of the "pre-relational database" days...  Mercifully, that was largely before my time, but  - primarily through a class - I got a taste of what the world was like before relational databases.  It's an understatement to say: YUCK! Gratitude for the power and convenience of Relational Databases and SQL - and relief at having narrowly averted life before it! - made me an instant mega-fan of that technology.  And for many years I held various jobs that, directly or indirectly, made use of MySQL and other relational databases - whether as a Database Administrator, Full-Stack Developer, Data Scientist, CTO or various other roles. But there were thorns in the otherwise happy relationship The root cause: THE REAL WORLD DOES NOT REALLY RESEMBLE THE

D3 Visualization with Vue.js : a powerful alliance (when done right!)

[UPDATED MAY 2022]  D3.js is a very powerful visualization tool, especially for specialized/custom needs...  On the flip side, it's rather hard to use - with a steep learning curve. Even worse if one also wants interactivity ! But why is D3 so hard/clunky to use?  And what can be done about it? Spoiler alert: Vue.js (or other modern front-end framework) to the rescue - if done right... All code in the examples is available in this GitHub repository . The Root of the Problem In a nutshell, what makes D3 awkward to use is that, for historical reasons, it tries to do too much : most painfully, it uses an old way to do direct DOM manipulation (i.e. restructuring the page layout) - an operation that nowadays is superbly handled in a far more friendly way by modern front-end frameworks, such as Vue.js Document Object Model ( DOM ) is a programming interface for web documents.  In simple terms, it's the structure of the elements on a web page (text, images, etc.) Let the front-e

A "Seismic Shift" in Longevity Science : Mainstream Acceptance + Large Funding

"You are incredibly prescient!"   I woke up to those words from a former colleague on Jan. 19, 2022: the bombshell announcement that the Chief Science Officer of pharma giant GSK, where I worked until recently, will become the CEO at the new, $3 BILLION longevity science company Altos (presumably also funded by Amazon's Jeff Bezos.) Big Pharma is at long last embracing Longevity Science. The corollary: longevity science is entering Mainstream (with capital "M") But let me backtrack... The Decade of Longevity Science When Harvard professor David Sinclair declared the 2020's to be the " decade of the paradigm shift about age reversal ", one could perhaps be dismissive of it as just an outburst of enthusiasm... But in the past couple of years, we're seeing strong evidence that his forecast is right on the mark! While I worked at GlaxoSmithKline - a giant, top-10, pharma company - I vigorously advocated forming a Longevity Science dept., and sp

Life123 : Quantitative Modeling of Biological Systems

(UPDATED 8/2022) - Are we ready to embark on a next-generation detailed quantitative modeling of complex biological systems , including whole-cell simulations?  An anticipated up-jump in computing power may be imminent from Photonics computers (which I discuss here ), and GPU's are rapidly gaining power as well...  Are we in ready state to put existing - and upcoming - power to good use? This is a manifest, and a call to action What's Life123? It's about detailed quantitative modeling of biological systems in 1-D, 2-D and full 3-D, as well as a multi-faceted software platform for doing so. What's (pseudo-)1D?  For now, let's say it's like the inside of a long, thin tube - with no interactions with the tube.  Likewise, (pseudo-)2D can be thought of as a Petri dish, with no interactions with the lid or the bottom. Website : A purposeful decision to also utilize 1D and 2D But why?  Yes, it's in part about "walk before you run&quo

Online Courses: (Often) Free and Just Awesome!

“Education is the kindling of a flame, not the filling of a vessel.” -Socrates.  [UPDATED Mar. 2021] Acquiring knowledge has been a hobby of mine since 4th grade, so it's no surprise that I'm the proverbial "kid in the candy store" when it comes to online courses!   As of writing, I have followed over 20 so far, and trying to decide what the next one will be... Utopia or Dystopia? You ever find yourself imagining the future, and wondering whether it'll turn out to be “utopian” or “dystopian”? Well, the state of higher education in the United States is decisively dystopian , with its absurdly ballooned costs and runaway student loans (a “bubble” that may burst sooner or later, mark my words!),  BUT there’s a counterpoint that is decisively utopian , namely the explosive rise of free online courses 😊 Here’s a brief 2012 Ted talk about the rise of free online courses , dated but still of interest. The gist of that TED talk is that online learning has com

Anti-Aging Research: Science, not Hype

Last updated November 2021 Q: "How is aging a disease?" A: "It's a dynamic system that veers away from its homeostasis (normal equilibrium point): hence a form of slow-progressing illness. Labeling it as 'natural' is a surrender to our traditional state of ignorance and powerlessness, which fortunately is beginning to be changed!" The above is my standard answer to an oft-asked question. The science of aging is by all evidence very misunderstood by the general public.  Hype, misinformation and unquestioned assumptions often prevail, unfortunately. Aging as a systemic breakdown of the body, rather than a series of isolated events and conditions. This 2013 diagram from NIH is a good way to jump-start contemplating the big picture: The diagram originates from the Cell journal: The Hallmarks of Aging   Telomere shortening is perhaps the one most talked about - but just one of several processes.  As stated in the above paper: Each

Interactomics + Super (or Quantum) Computers + Machine Learning : the Future of Medicine?

[Updated Mar. 2021] Interactomics today bears a certain resemblance to genomics in the  1990s...  Big gaps in knowledge, but an explosively-growing field of great promise. If you're unfamiliar with the terms, genomics is about deciphering the gene sequence of an organism, while interactomics is about describing all the relevant bio-molecules and their web of interactions. A Detective Story Think of a good police-detective story; typically there is a multitude of characters, and an impossible-to-remember number of relationships: A hates B, who loves C, who had a crush on D, who always steers clear of E, who was best friends with A until D arrived... Yes, just like those detective stories, things get very complex with our biological story!  Examples of webs of interactions, familiar to many who took intro biology, are the Krebs cycle for metabolism or the Calvin cycle to fix carbon into sugars in plant photosynthesis. Now, imagine vastly expanding those cycles of rea

Brain Microarchitecture : Feedback from Higher-order areas to Lower-order areas

Some questions that arise in Machine Learning involve the prospect of using feedback from Higher-order areas (downstream) to Lower-order areas (upstream), and using Global Knowledge for Local Processing.  A desire to gain insight into those issues from Neuroscience ("how does the brain do it?") led me to some fascinating investigations into the Microcircuits of the Cerebral Cortex.  This blog entry is a broad review of the field, in the context of the original motivating questions from Machine Learning.   Starting out with a quote from the “bible of Neuroscience”: From Principles of Neural Science, 5th edn  (Online book location 1435.3 / 5867).  Emphasis and note added by me: Sensory pathways are not exclusively serial; in each functional pathway higher-order areas project back to the lower-order areas from which they receive input. In this way neurons in higher-order areas, sensitive to the global pattern of sensory input, can modulate the activity of neurons in lowe

Photonic Computer - a "supercharged GPU" with very low energy consumption

Yes, we all wish for Quantum Computers... but in the meantime we need something here and now!  Could Photonic Computers fit that role? Just about everyone has heard of fiber optics – using light for data transmission – but did you know that light can also be used for computing? There's a new commercial product expected for early next year (2022) . I contacted the CEO, Nicholas Harris, of a 4-y.o. startup, Lightmatter , interviewed in April 2021 here . Photonic computers, at least in their first commercial appearance, are essentially accelerator cards for Linear Algebra - and so of special interest for Machine Learning and some types of simulations.    Their claims are remarkable: 10X faster than some of the best GPUs using 90% less energy can be used with existing software stacks, such as TensorFlow commercially available early next year (2022) a lot of future growth, as additional wavelengths of light get used in parallel My own interest is pr