Kai Staats: writing

Sun Beams and Seals

Small waves, calm, relatively warm, with little wind.

The sun was pushing through the clouds, forming those intense beams of filtered light to the horizon. Distant mountains shrouded in the mist.

A seal played with us at sea. He went beneath my board, back and forth and again, popping up his head and staring at me repeatedly. If I had reached down, below my board, I could have touched him. Then he dashed to another surfer and did the same, returning once. One of the surfers, a woman, squealed in delight. Everyone was engaged, hoping the seal would come to them next.

When the waves came, he used the momentum of the rolling water to propel himself into the air, diving into the wavefront again and again. Then there were two, playing in unison. I had tears in my eyes, salt water mixed with salt water. There is a connection I can’t explain, mammal to mammal perhaps, intelligent hunters who recognize when it is time to play.

We all know, as surfers, that if a seal is relaxed, playing, then there are no sharks around. If instead they pop their heads up, look around intently, take a deep breath and dart off down the shoulder of water along the beach, then we had better swim to shore too.

By |2017-11-13T03:11:39-04:00September 11th, 2017|2017|Comments Off on Sun Beams and Seals

Counting raindrops in Germany

Again I have promised myself to find sleep before 1 am. Again, I am awake, working to catch-up with my life after the intense experience of the International Space University, Space Studies Program in Cork, Ireland.

A moth flutters between the lamp shade and bulb. A distant jet passes overhead, by the sound neither arriving to nor departing from Frankfurt International Airport which is just a few kilometres distance from where I sit. This enclosed space provides the deeply nourishing aroma of untreated pine, floor, walls, and ceiling. An enclosed half gazebo is my resting spot each night, in the back yard of a family friend in Rüsselsheim, Germany.

Small spaces. Safe spaces. A room just big enough for a bed and table lamp, both resting on the floor; an area rug and place to place wet shoes. This is what feels right to me. Not the opposite of wrong, but right as in comfortable, natural, and satisfying.

We are so much driven to embrace thick walls, insulated ceilings, and windows that reflect heat and block sound that we forget what it means to fall to sleep to the wondrous sound of raindrops, falling, one by one.

By |2019-08-02T16:30:10-04:00August 30th, 2017|From the Road, The Written|Comments Off on Counting raindrops in Germany

Feature Construction with Genetic Programming

In working with LIGO supernovae data composed of noise-triggers (glitches) and supernovae-candidates (synthetic injections), we are pressing beyond a fitness ceiling measured by Precision-Recall. No matter the depth of GP tree or number of generations evolved, these features are not enabling the level of classification we desire.

Therefore, I am working to construct a new set of features. My first effort will be to use Karoo GP to evolve a small, multivariate expression which retains the value of its P-R score. In theory, when introduced back into the feature list, GP is able to start from this constructed feature, and build upon its inherent fitness score, thereby achieving a higher P-R value.

So, if GP evolves an expression which incorporates three of a dozen available features, and that function scores 80% Precision-Recall, then when evaluated against real data, row-by-row, that single output value itself provides an 80% P-R score without the need to evaluate those in that combination, again. If you have, for example, an evolved multivariate expression which provides an 80% differentiation of classes, its single, solved numeric value is also 80% effective as were the collection of features.

Here is an expression evolved by Karoo GP:

bw1 – 2*low + rh1 + vol/d0

Here is the equivalent expression, the original feature names replaced by the column positions in the dataset represented as a spreadsheet:

G2 – 2*E2 + A2 + B2/C2

Roughly 80% of the data points are in fact split across the x-axis such that class 0 (noise) are below and class 1 (sn event) are above, where the scatter-plot offers 2000 noise-triggers and 2000 candidate-events.

Maybe this will stimulate some ideas, or give a graduate student something to do over the weekend :)

kai

By |2020-08-15T13:53:31-04:00August 5th, 2017|Ramblings of a Researcher|Comments Off on Feature Construction with Genetic Programming

TensorFlow enabled Genetic Programming

GECCO ’17 Proceedings of the Genetic and Evolutionary Computation Conference Companion
http://dl.acm.org/citation.cfm?id=3084216

Abstract: “Genetic Programming, a kind of evolutionary computation and machine learning algorithm, is shown to benefit significantly from the application of vectorized data and the TensorFlow numerical computation library on both CPU and GPU architectures. The open source, Python Karoo GP is employed for a series of 190 tests across 6 platforms, with real-world datasets ranging from 18 to 5.5M data points. This body of tests demonstrates that datasets measured in tens and hundreds of data points see 2-15x improvement when moving from the scalar/SymPy configuration to the vector/TensorFlow configuration, with a single core performing on par or better than multiple CPU cores and CPUs. A dataset composed of 90,000 data points demonstrates a single vector/TensorFlow CPU core performing 875x better than 40 scalar/Sympy CPU cores. And a dataset containing 5.5M data points sees GPU configurations out-performing CPU configurations on average by 1.3x.”

My first 1st-author paper is published! Thank you Lee, Eddie, Marco, Arun, and Iuri for your input, support, and collaboration. –kai

By |2017-08-05T18:31:13-04:00August 5th, 2017|Ramblings of a Researcher|Comments Off on TensorFlow enabled Genetic Programming

The Seasons of our Emotions

There are as many faces as there are emotions, each powerful for what it conveys. Yet we wear them as though for the first time, unaware of their power to affect those we love.

If our smiles are the heat of summer and tears the rain of spring. If our naked bodies wrapped in blankets are autumn preparing for winter, then we can embrace each season as an integral part of the cycle, and look forward to what each brings.

By |2017-08-05T06:16:48-04:00August 5th, 2017|The Written|Comments Off on The Seasons of our Emotions

Postcard from Mars – a SIMOC update: August 01, 2017

ECLSS by Wikipedia commons

ECLSS
An Environmental Control and Life Support System (ECLSS) enables humans to survive in a semi-open (Fig 1) completely closed (BioSphere II, Lunar Palace) ecosystem. In a traditional model, all components vital to sustaining life are tracked by a network of system monitors. Careful estimations are made for the quantity of humans in the given environment for a particular period of time, against the resources provided. The amount of work they perform, the food they consume, and the number of hours they sleep all affect the duration and quality of the mission (see Wikipedia commons image, above).

In this linear tabulation of resource allocation and consumption each human actor or agent is treated as an IN and OUT box, a system which transforms one resource of a particular quantity into a bi-product which is either reused or discarded as waste.

To use this model for a massively scalable system (4-40,000 people) will result in an arduous, ultimately failing bookkeeping effort of tracking values such as the quantity of molecules of oxygen, carbon dioxide, water, calories, Watts or Joules. Through this linear method, we will be less likely to discover causality. If instead we can build a model which considers the relationship between two or more systems, which are themselves maintained by a constant input of energy and mass flow against the natural progression toward system breakdown, then we will gain a better sense of what it means to scale a human colony in a totally foreign, inhospitable environment, from the first astronauts to arrive to a genetically viable human gene pool that can, of its own accord, carry the human species forward.

A rendezvous with Rama
In our imagination, humans in a distant future have gained the ability to travel vast distances in relatively short periods of time. An exploratory mission discovers a massive, abandoned space station in orbit about a planet which itself is not conducive to life as we know it. We attach a shuttle craft to the hull of the outpost, tens of kilometers in diameter, and let ourselves inside. There does not appear to be a single living creature inside. Nothing moves, not even automated repair and management systems.

Immediately, we ask, For how long has this outpost been abandoned?

To answer that question, we determine if the atmosphere is breathable for humans, and we remove our helmets. The air is dry, cold, and devoid of the smell of decay. There is an odor of machine oil and mechanical systems.
While completely sealed, and safely parked in a non-decaying orbit far above the drag of the atmosphere, this habitat is decaying. It is slowly degrading. No matter how well crafted, no matter how perfectly every nut, bolt, and weld is applied, eventually this artificial world will fall to pieces.

You can point to the systems which are no longer being maintained: water delivery, sewage removal, atmosphere recycling systems. The ship’s hull is continuously bombarded with radiation from the binary star system 1.5 AU from the orbit of the host planet. Each of these is breaking down due to a lack of maintenance.

As we explore the inner halls and chambers of this orbiting world we take note of the integrity of the structure. Are seals in tact? Are lubricants leaking? Do the doorways to passages open and close securely? Do motors yet spin and pistons yet pump? Or have all moving parts seized and become immobile?

While we tend to measure breakdown over time, we can also measure the disorganization of the structure, at the macroscopic and microscopic levels. Physical breakdown of a mechanical system can be described as a degree of current functionality in comparison to its original design parameters. In this alien outpost, despite the incredible technology employed, we do recognize the failure of some systems (once rebooted and encouraged to operate again), such that we are able to estimate their original function and design specification. The difference between full capacity and the current state is a ratio which can be described as a normalized function, from zero through one [0 … 1] where 1 is complete, working order and 0 is a seized, non-functioning machine, no longer providing the intended service, and thereby no longer supporting this habitat nor the inhabitants who once occupied it.

This breakdown, the unavoidable decline of all bounded systems can be described by the single variable entropy, or the measure of organization.

SIMOC sketch by Kai Staats

So let’s take a few steps back, to a time when the alien station was yet inhabited. We can safely assume that at that time there was a maintenance schedule, a system by which the entire structure was maintained through routine inspection, repair, and replacement. This could have been done by the macroscopic hands of the aliens (who appear to be of a similar stature to that of the human explorers), an automated array of robotic assistants, or by microscopic nanobots whose function is to maintain the integrity of all functional systems, at all times, such that no weaknesses ever develop, and no systems ever suffer from catastrophic failure.

Either way, there is a cost to this maintenance, the work (w), or energy expenditure and mass flow to maintain the function (f) of the habitat. Organization (o) of this work requires management of information (i). As such, we have defined a means by which we can measure the status of a closed ecosystem:

  1. Organization
  2. Information
  3. Work

Function, then, is a relationship between the Organization, Information, and Work attributed to the sustained management of the habitat, or its total functionality. While each of these could be measured in any of number methods, we will place each in a tightly bound relationship to entropy, such that entropy is the counterpart, the undoing of organization, information, work, and ultimately the function.

Now, we have a new means of monitoring the health of the physical parameters of an isolated habitat, as:

f = (o [operator] i [operator] w) / entropy

Where the ratio is a measure of the effort or energy required to ultimately maintain a self-contained ecosystem without ever having had to count the molecules of oxygen, water, or complex carbohydrates. In a newly built habitat, the entropy is low, therefore the maintenance is low as well. But as the habitat ages, or if catastrophe strikes, the entropy will be large, thereby requiring greater organization, information, and work to bring it back into compliance with sustaining human life.

We are relating the current state of the system to its design specification over the inevitable force of entropy.

Back to Mars
If we employ a normalized set of values, as discussed above, then the maths is quite simple, even as we scale this colony from 4 to 400 to 40,000 individual habitants. This is not to say we will not count molecules nor worry ourselves with the atmospheric pressure in the greenhouse, for our model is in fact based on data accumulated from close-ecosystem and bioregenerative experiments on Earth. But to find those non-linear functions of scalability, we must remove ourselves from the line-item bookkeeping which would otherwise overlook the economies of scale which will surely affect a growing colony.

The habitat itself is designed to sustain human life in an otherwise inhospitable environment. As such, we can model the human lives of the astronauts by making certain the habitat itself is functional. We have established a potential framework built upon four parameters which enable us, at any point in the run-time of our SIMOC model, determine the relatively “health” of the physical structure of the habitat.

Now, let’s turn our attention to the health of the human habitants for which the habitat was designed and built Like a structure which is built from concrete, steel, glass, and soil, humans are composed of building blocks. Water, oxygen, calories, protein, vitamins and minerals make up the fluid and solid systems of our bodies.
How do we bring such discreet elements into the SIMOC model without managing each and every molecule that supports the lives of the human inhabitants of the isolated colony? In much the same way as we did with the habitat, we can look at the construct of the human body, and what breaks down over time.

One can see the human body as an assembly of points of failure, critical systems which must be satisfied. Oxygen intake, carbon dioxide exhalation, water, calories, nutrition, and waste management are as mission critical to the human body as is a sealed, pressurized shell to a habitat.

If we see humans as the caretakers of the habitat, that is, the principal labor force responsible for its anti-entropic upkeep, and the habitat as the physical construct which enables the humans to survive in outer space, or on a remote planet, then we have created a positive feedback loop in which each unit supports the other.

What happens when automated or directed robot labor replaces the human maintenance engineer? The labor is shifted from one entity to another, but the total work required to maintain the habitat is sustained, and the total quantity of humans supported, given the immediate infrastructure is not changed. Rather, the caloric expenditure of each human in the habitat is shifted to other functions, and the economy of scale is realized.

By |2019-07-07T13:55:47-04:00August 1st, 2017|Looking up!, Ramblings of a Researcher|Comments Off on Postcard from Mars – a SIMOC update: August 01, 2017

Counting raindrops in Ireland

From the passenger seat of this rented Opal, I watch seagulls contend for strings of seaweed and scraps of bait tossed overboard from a passing fishing vessel, the only one to enter Reen Harbour this Sunday morning.

Two dozen small ships are anchored here, in the neck of this natural safe haven. Some old, rusty buckets that have seen many storms; some new, clearly more for sport and weekend fun than generating income.

Michael, the principal guide of yesterday’s kayaking tour directed my attention to an otherwise elusive, black hulled, single mast sailing boat which is, he shared, simply gorgeous on the inside. The owner purchased the hull in another country and had it towed here, to Castletownshend, Ireland for an overhaul. A master craftsman, he has meticulously refurbished the interior to a degree that was best expressed by Michael as a whistle rather than words.

It is the owner’s intend to sail to Iceland, but recent poor weather has kept him here for a few weeks more. I was shocked to learn of this intent, for the boat appears quite small, with a square stern and equally vertical bow, it does now appear to the layman’s eyes the kind of ship one would take into then open, northern seas.

I slept here last night, in this rental car, after my second guided paddle for the day. Michael, his partner Caroline, and Patrick are passionate about their line of work, as they take customers onto the water two times a day, five, six, sometimes seven days a week. They carefully interweave the experience of exploring this harbour by kayak with history, biology, and a lesson in mindfulness training.

Michael suggests that we let go of all that we brought with us. In a tag-team fashion, Michael continues, “find your child’s imagination again,” for in that place lie the ghosts of history come alive in the silhouettes on-shore and the unknown treasures in the depths below.

We paddled through pockets of brilliant bioluminescence, pockets of phytoplankton that have by day stored the sun’s energy in order to release it again at night. Caroline shared that some 90 percent of the ocean’s lifeforms are able to produce visible light. The reasons for this communication are not yet fully understood.

The wake of a kayak, the twist of a paddle, even the flick of fingertips across the surface of the water invokes a magical light show. Michael snatched a net of seaweed and demonstrated how one could invoke a cacophony of illumination, hundreds of points of light popping on and off again.

We returned to shore just after midnight, but I was reluctant to exit my boat. I could have remained adrift ’till sunrise, content to watch, to listen, to take innumerable more deep breaths. The chilled, salty air of the coastal Irish night drew me into the comfort of my borrowed comforter which this morning continued to hold me tight.

The windscreen is littered with raindrops from the most recent ladened clouds. I have rolled the side windows up and down a few times already in concert with the passing clouds. The sun has shone but for a few minutes, only to retreat again to its own safe haven, a harbour for a celestial body relatively unknown in this land.

By |2019-08-02T16:30:55-04:00July 30th, 2017|From the Road|Comments Off on Counting raindrops in Ireland

Faster, easier, better.

What is this fascination with faster, easier, better?

I have heard it said that biology is lazy, that all creatures pursue that which requires the least energy expenditure. Perhaps entropy is the true guiding force, the omnipotent, intelligent designer, the deity which laughs when we grow to despise all but the very softest lap of luxury.

Have we not learned from our ancestors? Civilizations collapse when wealth exceeds labor.

How readily we forget, how easily we fail to recall, it is a challenge which grants us a sense of accomplishment, not arrival to the destination unencumbered.

By |2017-06-10T00:56:07-04:00June 10th, 2017|Critical Thinker, Humans & Technology|Comments Off on Faster, easier, better.

When I sell my vision

Research has its moments of upset, intrigue, and thrill.

But for this past six months these moments are lost to the effort of writing.

Proposal followed by proposal, I am a salesman with a briefcase full of ideas. Some new. Some old. Some revised. Some bold. If my visions for a better tomorrow are a good match to your funding of today, then we will enter into a partnership in which I am paid to investigate, experiment, and to play.

By |2017-06-10T00:12:27-04:00May 31st, 2017|Ramblings of a Researcher|Comments Off on When I sell my vision

Where Superstition welcomes the wary mind

Superstitions, by Kai Staats

Saguaro Blossom, Superstitions, by Kai Staats Spider Trap, Superstitions, by Kai Staats Wounded Saguaro, Superstitions, by Kai Staats Cholla Forest, Superstitions, by Kai Staats

Ocotillo, Superstitions, by Kai Staats As summer presses spring into a cooler memory, I find balance between the increasing heat and discomfort in the city with nights and mornings on the edge of the Superstition Wilderness.

Just one hour from downtown Phoenix, no matter if I arrive at dusk, well after sunset, or midnight, I am always eager to step out of my Subaru onto the rock of the turn-out where I frequently car-camp. The sound of crickets welcomes me to sleep. Birdsong wakes me to the rising run and immediate warmth that it brings.

Superstitions, by Kai Staats With daytime highs at 105F, the nights here remain cool. Boots on my feet by 6 AM, I walk cross-country, navigating between needles, hooks, barbs, and stones easily overturned.

Feeding the young, Superstitions, by Kai Staats

With every step comes a surprise, something new to discover and observe. I join wrens, hawks, lizards, chipmunks, rabbits, spiders and coyotes on the trail. There are homes made among the rubble of old mine shafts, in the hollow spaces of saguaro, and spanning the paths in hope of catching a small passer by. I fetch a light stick to tease a spider from its home, but it retreats back into its den when my large figure looms. A pair of hawks ride thermals, changing direction with effortless adjustment to the feathers on the very tip of their wings. A quick dive and recovered altitude suggests a potential meal escaped their talons, for now.

Campfire, Superstitions, by Kai Staats The only sounds are those of the breeze, a distant jet, and the rustle of needles, leaves, and stones under lizards feet as creatures scurry at my approach, or to stay cool against the warming sun. The aromas of creosote and cactus blooms mix with the ash of last night’s fire and I am, for this morning, at peace.

By |2019-02-18T01:29:46-04:00May 24th, 2017|At Home in the Southwest|Comments Off on Where Superstition welcomes the wary mind
Go to Top