Categories: sumana | Work
Volunteering, fulltime jobs, etc.
# 21 Aug 2013, 10:45AM: My Family And The Ada Initiative:
Please join Leonard and me in donating to the Ada Initiative. Why? Let me tell you a story, and then a surprise.
My parents came to the US from Karnataka, in south India, in the 1970s, and they were lonely. They spoke Kannada and English and Farsi and Hindi and Sanskrit, but Kannada was their mother tongue, and they arrived in Oklahoma and found no Kannadiga community to speak of. (Go ahead and groan. My dad passed on his love of terrible puns to me.)
I'm not saying they were the first Kannada speakers in the US. There were definitely already Kannadigas in the US in the 1970s. Indians had been immigrating here for decades.* There were letters and long-distance phone calls and occasional visits, a few families getting together, the adults laughing and swapping tips in Kannada while kids ran around. But the Kannada-speaking diaspora was scattered and had no central place to talk with each other. A bunch of people who shared a characteristic, but not really a community.
So my parents did some community organizing, in their spare time, in between working and raising my sister and me. How did they get Kannada speakers together? They started "Kannada Koota" local organizations (like user groups). "Koota" means "meeting" in Kannada. They basically started a grassroots network of Kannadiga meetups. How did they get these folks talking to each other, all across the country? They started a bimonthly magazine, Amerikannada, and ran it for 7 and a half years, until their money and energy ran out. It had great fiction, and articles from the literary magazines back home. And it included ads for those Kannada Koota meetups, "how I started a Kannada Koota" articles, and tutorial exercises for "how to learn Kannada", for parents to teach their kids. My parents were sharing best practices, talking meta, inspiring people all over.
I didn't really know that, as a kid. As my parents processed subscriptions, recruited articles and ads, wrote, and edited, my sister and I stapled, stamped, glued, and sealed bits of paper in languages we couldn't quite yet read. We had a rubber stamp with the logo: a griffin-like creature, half-lion, half-bald eagle. I gleefully deployed those magical bulk-mail stickers, red and orange and green with single-letter codes, and piled envelopes into burlap sacks and plastic bins for the frequent trips to the post office.
It was always my Dad who took the Amerikannada mail to the post office. He was strong in those days, heaving the great bags of mail like an Indian Santa Claus (mustache yes, beard no) alongside the blue-uniformed workers on the loading dock, the part of the post office most people never use or even see. My sister and I came along, not to help -- how could we? -- but to keep my Dad company.
At home, while toying with BASIC on a PC Jr, I overheard the shouted long-distance phone calls in mixed Kannada and English. Stuff like "Go ahead and give me the directions to the venue, and I'll tell it to Veena." or "Well you know who you should talk to? Raj is going to be over there around then...." Weekend after weekend I spent reading science fiction in some corner at a Kannada Koota.**
The funny thing is that I thought I was rebelling against my parents by taking the path I did. I majored in political science at Berkeley instead of engineering, and fell in with open source hippies. I used AbiWord on Caldera Linux to write papers about nineteenth-century American political theory and naturalization rates among Indians in Silicon Valley. I fell away from coding and saw that other things needed doing more urgently: tech writing, testing, teaching, marketing, management.
And here I am now, a community organizer like them, finally appreciating what they did, what they made, what they gave up. My dad had to work to support us; he couldn't edit Amerikannada full-time, even if that would have been a better use of his talents, and a greater service to the world. My parents couldn't find enough ads and subscribers to pay for the cost of keeping the magazine going. I appreciate WordPress and PayPal all the more because I see that Amerikannada folded (partly) for the lack of them.
What if one of my parents had been able to bring in income from the community we were building? What if it had been sustainable?
Today, the community that I most identify with is that of women in open source and open culture. We've talked to each other in pockets and locally for decades - hats off to LinuxChix and VividCon, for instance - but in the last few years, The Ada Initiative has brought us more resources, a stronger community, and faster progress than ever. And this is possible because the Ada Initiative's staff is full-time.
So, here's the surprise: Leonard and I will match every donation to the Ada Initiative up to a total of USD$10,000 until midnight August 27th PDT, one week from today. Yes, again. And this time, if the community matches the full amount, we'll chip in an extra thousand dollars.
The Ada Initiative's work is useful in our own lives. When I needed an anti-harassment policy for my workplace's technical events, and when Leonard wanted resources to advise his technical communities on diversity, we consulted the Ada Initiative's resources. AdaCamp brings together, teaches, and inspires women from all over, including me. And the network I found via the Ada Initiative helped me write a keynote speech and respond to unwanted touch at a hackathon.
But more than that, we know that we're improving our world and helping science fiction, open source, and Wikipedia live up to our values. We believe in inclusiveness, compassion, empowerment, and equal and fair treatment for all, and the Ada Initiative opens the doors for more women to get to enjoy those values in the places we love.
And my parents taught me that I should give back. It feels so much better to give back than to give up.
* One couple who moved from Gujarat to California in 1958 had a son who's now a Congressman.
** Nowadays I get to be the only Kannadiga at science fiction conventions.
# (1) 12 May 2013, 09:49AM: Tips for New Summer Interns:
Three tips to help new Google Summer of Code applicants and interns, some of which all remote workers could stand to remember:
- Never let yourself get stuck on a technical question or problem for more than half an hour. Take a break, ask questions in IRC or a mailing list, find a technical book to read like
The Architecture of Open Source Applications, look at some other codebase to
see how they do it, eat a meal, or do something else, then come back to
- Never let yourself get stuck waiting for someone's reply for more
than 2 business days (Monday through Friday). Escalate -- ask your
mentor. If your mentor isn't helping, ask your org admin. If the org
admin isn't helping, ask on the GSoC discussion forum, or email Carol Smith.
- Ask yourself at the start of every day: what did I accomplish
yesterday? What will I try to do today? What are the obstacles I think I will run into? If you ask yourself those three questions and answer honestly -- especially if you let your mentor and team know the answers -- then you will prevent long delays and help keep your morale up.
# (3) 31 Mar 2013, 09:17AM: Open Tech New York City:
Yesterday I delivered a reasonably well-received talk at Open Tech NYC in which I introduced the crowd to their New York open tech neighbors. That is, I explained the four freedoms that define what make software truly free and open, and I gave examples of NYC people and institutions who make or use open culture and open knowledge, open data, open source software, open formats and open hardware.
Here are a bunch of links!
- Culture and knowledge: Wikipedia and other Wikimedia sites -- check out Wikimedia NYC, which collaborates with libraries and other cultural institutions such as the New York Public Library. QuestionCopyright is a nonprofit org that educates artists about alternative licensing and advocates against copyright maximalism. And the Organization for Transformative Works "is a nonprofit organization run by and for fans to provide access to and preserve the history of fanworks and fan cultures."
- Data: the municipal government open data sets are available, and are consumed by organizations like local nonprofit OpenPlans. In February, look for Open Data Day, which had a Code for NYC event this year. (And look at New York City in Wikidata!)
- Open formats: Aaron Swartz, honorary New Yorker, was one of the inventors of RSS.
- Software: I mentioned a few organizations that produce open source software. Socialbomb in Brooklyn helps work on the Tornado web server. Brooklyn-based OpenGeo makes the OpenGeo suite of geographic information systems software. 10Gen in Manhattan makes MongoDB. The Museum of the Moving Image in Queens is working on CollectionSpace, software to help run museums. ProPublica makes tools for data journalism (blog). OpenITP (the Open Internet Tools Project) in Manhattan "supports and incubates a collection of free and open source projects that enable anonymous, secure, reliable, and unrestricted communication on the Internet. Its goal is to enable people to talk directly to each other without being censored, surveilled or restricted." OpenITP is part of the Open Technology Institute, which helps make Tidepools (social wifi).
I mentioned consumers and users of open source among our neighbors. Drupal and WordPress are pretty useful to consulting shops like Behavior. Google makes some open source software but also uses a bunch; for instance, their servers run on a slight variant of Ubuntu Linux. And an art installation in the New York Times lobby uses the Beautiful Soup screen-scraping library that my spouse wrote.
- Hardware: We have Makerbot in Brooklyn, including Thingiverse, and we have Shapeways in Long Island City. And NYC Resistor is a hacker collective in Brooklyn that has get-togethers all the time.
- Events and meetups: Gosh we have a lot. Python and Ruby and open source data analysis groups, for instance. The Drupal community's hosting a Drupal Ladder sprint on April 7th at Elephant Ventures in west midtown, helping new contributors get started. You can come to Techno-activism Third Mondays at OpenITP. Wikimedia NYC hosts events every few months. And for open hardware, check out Maker Faire in September, and the Shapeways meetup. I should have also mentioned Free Culture Conference 2013, April 20th and 21st at New York Law School, and the New York Linux Users Group.
I hope the people listening understood that I was just offering a sample of the organizations in the five boroughs that work on or use open stuff! I opened and ended my speech with some thoughts about love and sharing (and how being a free software person is like or unlike being a vegan), which I reused from "A Slightly Disjointed (Due To A Five-Day Cold) Musing On Open Source, Fear, Motivation, And Witnessing", where I discuss my experience with the open source GNOME desktop environment.
During the coffee breaks and lunch, I also spread the word about Outreach Program for Women and Google Summer of Code internships available this summer; application deadlines are around May 1st.
Thanks to the sponsors and organizers of Open Tech NYC 2013. I enjoyed it despite getting over a cold, and appreciated the chance to learn from and chat with a variety of people interested in open stuff.
Update: Video is up.
# 06 Feb 2013, 07:47PM: What Systems Administrators Do:
I hope you'll read two blog entries I just wrote, whether you consider yourself a "techie" or not. They're meant to explain why the recent Wikimedia data center migration was difficult and took a long time, and how our systems administration department has started being able to respond to problems faster, and prevent them. And I wrote them in the hope that non-programmers will be able to appreciate my colleagues' work.
From duct tape to puppets: How a new data center became an opportunity to do things right (using Puppet for configuration management).
How the Technical Operations team stops problems in their tracks (fixing crises and preventing them with Nagios, Graphite, & Ganglia for monitoring & profiling).
Sometimes non-sysadmins don't appreciate the work that sysadmins do, building and maintaining infrastructure so the rest of us can use websites without thinking about it. But it's important work and I hope these posts help Wikipedia and Wikimedia users recognize it.
# (2) 01 Dec 2012, 10:35AM PST: We Are Hiring - You Too?:
Wikimedia Foundation is hiring, a lot. We need your help to:
And of course everything you make at the Wikimedia Foundation is freely licensed, so you can suggest your buddies use it to solve their problems, write public blog posts about it, talk about it at parties and conferences, and link to it on your résumé. Isn't open source rockin'?
Some other places that make open source software and are hiring:
Linaro, 10gen (makers of
Culture Foundation, Balboa Park Online Collective, CollectionSpace, Mozilla, OpenStack, Red Hat, Canonical, Collabora. And you can check the
FSF jobs board.
If you're hiring people to improve open source -- designers, tech writers, product managers, sysadmins, coders, etc. -- feel free to leave a comment. I know a few FLOSS-ish folks who are about to start looking and maybe I can direct them your way as well.
# (1) 30 Nov 2012, 05:54PM: I Am A Software Developer:
I arrived in San Francisco yesterday in just enough time to speed to Wikimedia Foundation headquarters and present:
Watch, live, via screensharing as a developer fixes a bug, including investigation, git commit, getting it reviewed and merged, and closing the Bugzilla ticket. Probably featuring Sumana Harihareswara. Great for newbies!
About 25 people watched the YouTube stream, which you can now view (it's about the first 20 minutes; the IRC log starts at 20:30:36). A copy of the video should get to Wikimedia Commons sometime in the next week.
A small part of me thought I was defrauding the viewers by masquerading as a developer. Because, sure, I fix user-visible strings and all, and I can read code okay, but (insert moving-the-goalposts here).
This morning, of course, I woke up too early from jet lag, and was listening to calming music, trying to get back to sleep. And then I realized that I hadn't fixed the second half of the demo bug. So I dragged myself upright and opened my laptop and made the fix.
Okay, now I'm a developer. An occasional, entry-level software developer, but one nonetheless. I viscerally believe that the ritual that brought me into that guild was not yesterday's commit, but today's.
# (6) 29 Oct 2012, 02:53PM: Leonard And I Will Match Ten Thousand Dollars Of Your Ada Initiative Donations:
Leonard and I met because of the open source movement. We owe our livelihoods to open source, and its values -- inclusiveness, compassion, empowerment, equal and fair treatment for all -- help make us who we are.
This is why he and I are pledging to match up to USD$10,000 of donations to the Ada Initiative made before November 1, 2012.
The Ada Initiative works to increase the participation of women in open technology and culture. They gave me the wording and support I needed to create Wikimedia Foundation's Friendly Space Policy for technical events, which helps everyone at a Wikimedia hackathon feel safer so they can concentrate on rockin' out. If you liked "Be Bold: An Origin Story", the keynote I delivered at Open Source Bridge this year, thank the Ada Initiative, whose advisors helped me shape it. Everyone who wants to grow the open source community benefits from the Ada Initiative's work, and so donating to TAI is like investing in a good piece of machinery; TAI's going to make my work easier for a long time to come.
Please join us in donating to the Ada Initiative, especially if you've also gotten a good career out of open source.
# 28 Sep 2012, 10:01AM: Sometimes An Unconference Is The Wrong Choice:
Now that I'm something of an expert on it, I have Opinions on how to structure a workshop or collaboration event for newbies. Summary of my answer:
- define your goals very clearly and specifically
- skip unnecessary tactics
- choose how to use some mix of speeches, tutorials, sprints, and breathing room
We all want to avoid stultifying slide presentations, and if we preplan the schedule, we might choose irrelevant topics or activities. One alternative is Open Space Technology, which substitutes an alternative, more participatory event structure and nearly guarantees that no one will fire up PowerPoint. Some planners (and participants) think that all planned activities are per se useless, and that thus we should only do unconferences that follow an Open Space model, regardless of the event's audience. More often I run into new event planners who default to "we'll do an unconference" without thinking about whether that's the best tool for the job.
When people suggest removing traditional structure from collaboration events, I think of Mako Hill's research on why Wikipedia succeeded and other contemporaneous projects didn't (summary, audio and video). One reason is: even though the peer production model was unfamiliar and chaotic and new, the goal (an encyclopedia) was well-defined. In contrast, these other projects were trying to redefine both process and THE NATURE OF KNOWLEDGE CYBER COLLAB DISTRIBUTED ETC ETC: both process and outcome.
I think that workshops are kind of like that. You can either be innovative, groundbreaking, and inclusive in what you are doing or how you are doing it, but both, simultaneously, is very hard. (This is also an issue with Agile.)
If you are planning an event for people who already know and trust each other, and are good at public speaking and collaboration, and are experts in the field, then an unconference might work! But for newbies who are learning not just a new skill, but a new way of thinking? Give them a more familiar structure. (WisCon is an interesting example here. It's a massively multiplayer conference: anyone can suggest sessions or suggest themselves as copanelists or moderators. But a programming committee processes that input ahead of time into a great at-con schedule.)
This is tough for free culture ideologues, because one wants to "be the change you wish to see in the world", and do everything collaboratively, empoweredly, etc. But sometimes the ivy needs a trellis to grow on.
I think event organizers should consciously design space in the structure for breathing room. People get a lot out of the breaks, the hallway track, and unconference sessions. But I think it's rare to have a good hallway track without some interesting and structured stuff happening in the rooms just off the hallway.
# (2) 27 Jun 2012, 03:57AM: Be Bold: An Origin Story:
I'm getting very positive reviews for my opening keynote from Open Source Bridge.
Video (starts around 6:00), speaker's notes (text that needs updating to match the audio).
# 19 Jun 2012, 06:17AM: Conference Seasoning:
You know you're traveling too much when you completely stop updating the "where I'm going to be" feeds (example).
Regardless: I'll be in San Francisco starting late today, and then in Portland on Monday the 25th, the day before I give the opening keynote address at Open Source Bridge. My tentative title: "Be Bold."
Wikimedians are giving several other talks during the conference:
The Wikimedia Foundation is also sponsoring the Friday unconference day, and will host a hacking table that day as well as (I hope) the Tuesday "Hacker Lounge Project/Community Night."
Then, I'll be in Washington, DC, July 10th-15th for Wikimania, especially the pre-conference Hackathon. I'm happy to announce that WMF is partnering with OpenHatch to make the pre-Wikimania hackathon even more useful. OpenHatch is planning and running the novice-focused half of the event, with trainings and projects to help people learn how to hack Wikimedia technology.
I'm leading at least two talks at Wikimania:
I say "at least two" because who knows whether folks will rope me into moderating a panel, or doing some stand-up comedy.
# (1) 19 Jun 2012, 05:54AM: Challenge:
Wikimedia Foundation is hiring a leader for volunteer software testing. I have ideas on what this person should do and how to do it* -- indeed, this position reports to me -- but more than that, I have ideas about what kind of person I need to find.
I need someone who has skills in open source contribution, who gets the wiki and open source way. Even if the person lives in San Francisco -- which they don't have to -- they have to collaborate well remotely, with volunteers and other colleagues. And I seek someone who has the focus and analytical skill one needs to test software, and the hospitable and generous temperament one needs to encourage and teach newbies.
I've been bookmarking lists of suggestions for ways to test, like You Are Not Done Yet and Falsehoods Programmers Believe About Names and its sequel on time. We've already started running online events for new testers. If talking like this is scratching an itch for you, even if you've never had a job title as a software tester, please apply. At least we'll have an interesting conversation.
* Had I worlds enough and time, I would start a retraining school that turned underpaid copyeditors into versatile and sought-after software testers. Proofreaders can already follow instructions and communicate effectively and deploy critical thinking skills while nitpicking, so they just need some guidance in learning some domain knowledge. (One of the great benefits of the modern technology industry is that it provides productive and lucrative channels for pedantry.) I do not have the time to do this for profit, but perhaps my Engineering Community Team can use this kind of arbitrage to recruit and train volunteers, give them some skills to put on their résumés, and get some more quality assurance.
# (5) 23 May 2012, 11:45PM: A Local Maximum:
By the way, I got promoted. It's quite an honor.
Wikimedia Foundation's new Engineering Community Team, which I lead, is a renaming of the TL;DR group. We've written a draft summary of our goals for July 2012-June 2013. There's so much to be done! (Of course, we're hiring.)
In open source, we share our vulnerabilities and our milestones, so of course my boss announced my promotion to a public mailing list. I was surprised and delighted when colleagues and contributors in my community responded to that announcement with congratulations, privately and publicly. It is as though they believe I am doing a good job! Take that, impostor syndrome.
I'm thinking about the thirty years of influences that got me here. As a teen, I volunteered for the Peace and Justice Network of San Joaquin County, and met my mentor John Morearty, whom I saw this past weekend. Before I knew Sam Hatch, and before I knew Seth Schoen, even, I knew John, a teacher who took his values seriously and was always ready to teach. He led volunteer communities that aimed for inclusiveness and viral change. He modeled grit, open-mindedness, and compassion, and I saw in his example that another world was possible, another mode of being. He wrote a fascinating memoir that you should check out, if you like twisty life stories.
John had twin sons, Mike and Brian. I got to meet Mike on Sunday. On Monday he got write access to Wikimedia Labs, Git, and Gerrit. I find this confluence pleasant yet dizzying, like the bushels of jasmine in John's garden. There's so much to be done, and the abundance of my world may yet provide. As John reminded me this weekend, we cannot build the new systems we need; we must cultivate them.
# 04 Dec 2011, 08:18AM: Asymptomatic, Asymptotic:
Last night I gave Leonard some alone time to work on a Constellation Games bonus story. I went to Ward III, a Manhattan bar that does bespoke cocktails. They have a menu of predesigned cocktails as well, but if you tell them, "I would love something bubbly with basil and lemon," they think about it and figure something out. I especially appreciate that they are perfectly fine with making interesting nonalcoholic drinks. I don't know a better place to get a bespoke mocktail.
While there, I read a bit of Making Software. One of its editors also cowrote "Empirical Software Engineering: As researchers investigate how software gets made, a new empire for empirical research opens up" in the latest American Scientist, in case you want a taste of his approach. We can now do metasurveys and overviews of existing research into software development, and the science says:
Pair programmers tend to produce code that is easier to understand, and they do so with higher morale. Their productivity may fall initially as the programmers adjust to the new work style, but productivity recovers and often surpasses its initial level as programmer teams acquire experience....
Large meta-analyses and further studies by Hannay and others conclude that a programmer’s personality is not a strong predictor of performance. The people who swear by their beliefs about personality and programmer success have now been given reason to assess their position critically, along with methodological support for doing so....
....the distinctions between the two worlds are often illusory. There are cathedrals in the open-source sphere and bazaars in the closed-source. Similar social and technical trends can be documented in both.... Schryen and Rich sorted the packages they studied within categories such as open- and closed-source, application type (operating system, web server, web browser and so on), and structured or loose organization. They found that security vulnerabilities were equally severe for both open- and closed-source systems, and they further found that patching behavior did not align with an open–versus-closed source divide. In fact, they were able to show that application type is a much better determinant of vulnerability and response to security issues, and that patching behavior is directed by organizational policy without any correlation to the organizational structure that produced the software.
I read about software engineering research while sitting at the bar, over lemon-lime-and-bitters and devilled eggs served with slices of jalapeño. I always love getting to watch people who are good at their jobs, and the craftsmen at Ward III have a particularly explicitly collaborative style with their customers. One of them, Michael J. Neff, blogs at Serious Eats about cocktails and tending bar. He writes thoughtfully about the use of sugar, free-pouring versus using jiggers to measure, why Californians like us find hurricanes so unsettling ("I tend to think natural disasters should be short, violent, and most of all, unannounced."), and the downside of cocktail nostalgia.
Much of the current cocktail trend is based on nostalgia, and it is difficult to say it, but many cocktails that we now call "forgotten classics" are forgotten for a reason. They have the shine of history, and we're told we are supposed to love them, but they're too sweet, they lack balance, and they kind of suck....
...none of us invented the cocktail. Whatever we create now is a collaboration between those who make spirits, those who make cocktails, and those who imbibe them. If we leave behind the drinker, we leave behind the only people who can tell us what works. None of us make cocktails in a vacuum.
No matter what field you're in, it can be hard to hear criticism. It can be hard to switch habits in response to new data, from your customer or from research. But that's what learning is. Disequilibrium -- surprises, failures, jokes, and disorientations -- will always happen. Taking that opportunity to move away from a local maximum towards a global maximum is up to me.
# 12 Nov 2011, 10:09PM: Work And Being Realistic:
This month I'll briefly be in Mumbai for a Wikimedia developers' meetup. Developers and translators will be working on mobile and offline access, localization, and general knowledge sharing about Wikimedia technologies. If you're interested in coming by, let me know.
Selected recent Wikimedia (work) stuff: Guillaume Paumier did important foundational work in collecting and integrating information for a MediaWiki architectural overview and history. I've already pointed newbies to it at least five times to explain something. And the first MediaWiki 1.18 beta release is out so people can download and test that. We're hiring for like a dozen technical positions. There's so much going on that if I go on I'll end up repeating our monthly reports.
Perhaps more interestingly, my current crusade is patch review. When new technical volunteers show up, perhaps trying to scratch their own itch or get started with an annoying little easy bug, they contribute patches in our Bugzilla. We're not reviewing and responding to them consistently and quickly enough; there are more than 260 patches awaiting a response, some dating back years and thus suffering bitrot. So, the workflow isn't working. I'm working on figuring out what's broken and how to fix it.
All my Wikimedia work and travel has kept me from my previous big open source commitment, GNOME. I've been saying to friends and GNOME teammates for some time now that I can't keep up, and am now unsubscribing from the GNOME Marketing and GNOME Journal team email lists in recognition of that fact. It hurts, but it's better not to pretend to commitments one can't keep. Fortunately, Emily (Rose? not sure of her last name) & Sriram Ramkrishna have done a great service in moving GNOME Journal to a modern publishing system at https://thegnomejournal.wordpress.com/. It looks like they'll take over running and editing it, which is lovely. Paul Cutler and I simply have not had the time to give this information channel the attention it deserves, so he and I asked for others to step in and take over, and I am glad to see Sri's, Emily's, Allan Day's, and others' energy pushing forward to keep the GNOME and FLOSS communities informed about GNOME happenings.
We are in this together. It's like the geek feminist saying goes:
Let's say that fighting sexism is like a chorus of people singing a continuous tone. If enough people sing, the tone will be continuous even though each of the singers will be stopping singing to take a breath every now and then. The way to change things is for more people to sing rather than for the same small group of people to try to sing louder and never breathe.
The demands of scaling up imply, somewhat recursively, that in my role coordinating and recruiting volunteers, I need to also recruit people who will coordinate and recruit volunteers. I'm working on it.
# (6) 01 Sep 2011, 06:22PM: Everybody's Doing It: Some Hackathon Tips:
I'm helping arrange some developers' events at work. They're meant for open source software developers, testers, documenters, and other contributors to get together, talk, and collaborate. We often call them hackathons. I'm directly planning, with a colleague, the October 14-16 hackathon in New Orleans. But I'm also advising volunteers and people at partner organizations who want to put on technical events -- for example, a British contributor is planning a hackathon in Brighton, 19-20 November. The Wikimedia Foundation itself can only put on a few events a year, but there's plenty of room and demand for smaller regional meetups, so I'm enthusiastically encouraging volunteers who want to throw a hacking party.
People keep acting as though I'll have useful advice for them in hackathon planning, so here goes! I do not want to reinvent the wheel here, so I'm liberally linking to others' existing guides and HOWTOs.
My colleague Siebrand Mazeland wrote some goals for an upcoming hackathon and I like them as an example. Note that this is for an event where we're expecting that most participants will be new to MediaWiki and to open source development in general:
- Inform participants about how the MediaWiki community works
- Inform participants of the major development languages and tools for MediaWiki
- Provide a brief, comprehensive, accessible overview of the exciting projects MediaWiki developers are working on -- convey that anyone with PHP knowledge, and who wants to build an excellent open source CV, can participate in the community
- Get current developers talking to prospective developers
- Get a few people (1-3) that were not MediaWiki developers beforehand to be MediaWiki developers within 2 months after the hackathon
First I'll talk about the social/content side of hackathons, and then some outreach/process stuff, and then the technical/logistics side.
People & Activities
Here's what I wrote while helping plan an upcoming hackathon, one of the first in its region:
Since I predict that at least half of the participants will be new to
MediaWiki-related development, we'll want to seed the crowd with some
more experienced developers (if possible, from the region). And we'll
want to provide some direction and some pre-planned activities,
especially for the first day (if we're assuming a two-day hackathon).
One of these activities should be the "how to start modding MediaWiki"
lecture/workshop that we first led at Wikimania. A colleague and I will
be cleaning up those notes in
September to create a curriculum that a local developer could use to teach.
Other preplanned activities would include just enough structure to
help inform and guide the energy of new, uncertain participants. For
example, organizers should ask several local developers, ahead of time,
to prepare sets of tasks that small groups could work on, such as "fix
these ten bugs in Kiwix" or "add language support for (this language) to
(tool)." It would be best if these developers could also give extremely
short talks about their areas of interest (3-5 minutes each, no slides
necessary). In the afternoon of the first day, and at the beginning of
the second day, there would be a twenty-minute period of these
"lightning talks" and then participants could decide what group to join.
I am generally in favor of allowing some room for spontaneity, by asking
participants on the first day what they're interested in working on,
encouraging them to give ad hoc lightning talks during the short talks
sessions, and by encouraging participants to lead sprints on topics of
their interest. Technologists feel more inspired and creative if
there's lots of support (people who are willing to teach and mentor) but
also freedom to discover and concentrate on new interests.
It's tempting for organizers to say "let's concentrate on this! and
this! and this!" at a hackathon. But you can't concentrate on
localisation, and mobile, and accessibility, and HTTPS, and mass
uploaders, and usability, and the article feedback tool, and and and.
:-) If you really want some topic focus at the hackathon, choose maybe
2 concentrations a day, and target your outreach and publicity, saying
that you especially welcome participation in those areas.
Some Things You'll Need
for a successful developer outreach event:
- a public wiki page stating the date, time, and venue, and specifying that everyone is welcome. Also tell people what to bring (laptop and power cord), ask them for topic ideas, and ask them to put their names down -- no obligation. A sample.
- outreach/publicity drive, starting at least six weeks in advance, to relevant
communities. Ideally you'd get the word out to technical interest
groups, local user groups, consultants and other businesses in the
industry, individuals whom you want to attend, professors and colleges
and universities and technical schools and trainers, email lists, and
(if relevant to your audience) newspapers.
- some experienced developers. I don't know the exact ratio, but
perhaps a fifth of your participants should be people who have had some
experience in developing Wikimedia/MediaWiki stuff, loosely defined.
You need some seeds.
- documentation tools & some people who will take notes with them (more below).
- lightweight tracking. At some point, somehow, at the event, get every participant's name and email address. That way you can follow up and
continue encouraging them after the event.
Technical stuff & logistics
I find that the Stumptown Syndicate's Event Planning Handbook section on logistics ably summarizes the logistical side of what's needed at a technical event.
Basically, once you have a venue, the next priority is provision for
robust wireless (and, if possible, wired) internet, and provision for
heavy electrical power usage.
You'll want to have some kind of documentation of your hackathon, to
make it easier for people to collaborate (face-to-face and remotely),
and to have a record for future reference. As we decided for the Berlin WMDE hackathon this year (thanks to Daniel Kinzler for distilling this hierarchy):
- textual documentation: essential
- live textual documentation (IRC, Etherpad): important
- photo documentation: important
- audio recording: important
- video recording: would be good
- audio streaming: would be good
- video streaming: nice to have
It's great to have two dedicated notetakers/facilitators typing into
Etherpad for collborative notetaking, finding and answering questions on IRC and blogging, and walking around talking to people and asking them what they're working on and helping them collaborate more effectively.
And below I'll reproduce a note that Jon Davis, formerly of Wikimedia
internal IT, wrote about audio recording and streaming (when planning
for the Berlin WMDE developers' days):
The biggest problem is getting reasonably quality audio to a computer. The single biggest complaint I've had... was that it was hard to hear people. [You'll] need some reasonably quality microphones to capture with. If it is presentations, I recommend some sort of shotgun style mic. If it is a group talk, something omnidirectional. The trouble is twofold.
There is probably far better advice out there regarding recording/streaming video and audio. I welcome links and experiences.
#1 - I couldn't find any USB compatible shotgun mics off hand. You can, in effect make one with the right parts , , but it's definitely not cheap.
#2 - The USB omni-directional that I found  isn't cheap, and I've no idea what the quality is.
So [you'd] need at least one mic setup (and probably computer) per area [you] are trying to record. It's not... "great", but it sure beats running a ton of cable, doing mixing and all sorts of much more pro level work. I have no idea what the budget is for that sort of thing, so it might not be a big deal...
You'll also want to consider bathrooms, garbage needs, whiteboards and
markers, and maybe childcare, and so on -- the sorts of things
conference organizers need to consider, in general. A few guides with
tips on what to consider:
And of course there is a lot of "how to run a conference" reference material available for your perusal, including ConRunner, which focuses on science fiction convention organizers but which has more generally applicable advice. And hey, they're running MediaWiki!
Questions, links, comments welcome in the comments.
# 17 Jul 2011, 10:53AM: Intra- and Interpersonal Expectations In Open Source And the Tech Industry:
That theme emerges in the three articles I've written for Geek Feminism this year.
- January: "On competence, confidence, pernicious socialization, recursion, and tricking yourself" (previously mentioned in Cogito, Ergo Sumana). I have to remind myself to take my own advice and take more risks -- if I succeed all the time, I'm not thinking big enough. Echoed in Sheryl Sandberg's Barnard commencement speech.
- July: "'Put up or shut up'." I wrote this to explain the double-edged sword of the do-ocratic norm, to describe how we sometimes use it to shut down uncomfortable conversations, and to remind us that the very people who need certain new policies, procedures and abstractions are least able and worst placed to implement them. There's a difference between "that's definitely an issue; could you file a bug?" and "stop talking about this unless you're prepared to implement it all by yourself."
- Also July: "Google, gossip, and gamification: comparing and contrasting technical learning styles" tells my tale of failure and return, then asks: how do you learn technical material and skills? I'm especially interested in hearing from women who now spend a lot of time in a technical domain, but whose first attempt at learning it went awry.
By the way, if there's something you wish I would write about, do let me know.
# (1) 11 Jul 2011, 11:11AM: Kyriarchy & Mr. Rogers:
In late June, Kjerstin Johnson interviewed me for Bitch Media (makers of Bitch Magazine) about Wikimedia, feminism in open source, and related topics. You can listen to the half-hour interview via download from the Internet Archive, or read the transcript (4800 words, 67KB .doc file).
So open source means that anybody can modify the code; closed source means that no one else other than the people who basically sold it to you can modify it, and therefore you are disempowered, and you are under someone else's control. And as Mr. Rogers once said, "I am against the idea of anybody being programmed by anybody else."
The actual quote is: "Very frankly, I am opposed to people being programmed by others." I'm pretty sure I first ran into it in Seth Schoen's email signature.
# (1) 10 Jul 2011, 01:22AM: "Learn Tech Management" Essay/Notes:
Final notes, including an audio recording and an edited & annotated transcript, for my standing-room-only talk "Learn Tech Management in 45 Minutes" from this year's Open Source Bridge.
And I wanna also tell you that I am gonna talk a little bit about kind of managing up and managing down, but really more of what I'm talking about is managing up, because I think a lot of us have had at least some experience of managing other people and helping them understand what to do, but managing up is where it gets all mysterious, and people wear suits, and they talk about terms we don't understand.
And I think of this as kind of harm reduction. This talk that I'm giving right now. It's a little bit of the gentle art of self defense. Because, you know, you might be an engineer who has to deal with management and fight for your project, or you might want to take leadership of your open source project, and you might want to write proposals for what people should do or why they should give you a grant. Or you might accidentally turn into a manager at your firm. It might be foisted upon you.
And so I hope that some of the stuff in this talk will take you from, like, 0th percentile up somewhere else, and give you a bunch of keywords that you can look up on Wikipedia, the world's free, open source encyclopedia.
Subheaders include "Why do projects fail?", "Evil list", "Suit-friendly presentations", "Lenses", and "Q&A about measuring intangibles".
Much thanks to Christie Koehler for getting me that audio, and to Mirabai Knight of StenoKnight CART Services for transcribing my talk. Thanks to Reid Beels for the CC BY-NC-SA photo.
# (2) 29 Jun 2011, 07:01PM: Open Source Bridge 2011:
I had a wonderful time at this year's Open Source Bridge conference. Last year at OSBridge, I presented "The Second Step: HOWTO encourage open source work at for-profits" and had a great time. So this year I spoke on technology management, with the fairly ambitious title "Learn Tech Management in 45 Minutes". Addie Beseda reported such a high turnout that people were standing in the hall outside the door listening to the talk, which blows my mind. Audio and polished notes coming soon; slides & nearly complete notes available now.
Because we released MediaWiki 1.17.0 (after 11 months of development and review!) while I was in Portland, I also led an unconference session on "What's new in MediaWiki 1.17 and How You Can Help". People volunteered to help us with PostgreSQL support, testing, design ideas, bug triage, the parser, and more. And I got to talk about the new release with Ward Cunningham, who invented the wiki. That has got to be a Sumana career highlight.
I also performed some geeky stand-up comedy, and people liked that. So that's nice.
Sessions I attended:
DNSSEC @ Mozilla -- way over my head, which is fine.
- A Dozen Databases in 45 Minutes -- I found this very useful in helping me understand, among other things, why one would privilege availability over consistency. Thanks to speaker Eric Redmond for some memorable metaphors.
- Drupal Distributions, an Open Source Product Model made me think about the danger of fragmenting sub-communities within a larger FLOSS community.
- The open source communities panel -- I did not pay enough attention to this, as I was finishing up work on my talk. I do remember some people disagreeing about qualitative versus quantitative release management decisions and about how to recruit and mentor new participants; sadly I don't have any useful recollections.
- Selena Deckelmann led "How to Ask for Money", which I think many people will find useful. Some of their lessons: "Find a fundraising mentor," "Hire a graphic designer", "Your network is bigger than you think," "Ask again anyway," and "Do what you say you'll do. And if you don't, communicate why - now."
- Dawn Foster's fantastic "Online Community Metrics: Tips and Techniques for Measuring Participation" was -- to all the community managers in the room -- worth the price of admission on its own. Hit the slides (per her blog post) for great pointers to MeeGo's statistics, MLStats for mailing list analysis, irssistats for IRC analysis, and more. And I have some additional notes at the talk's OSB wiki page.
- The Birds of a Feather session for Google Summer of Code proved educational; students, alumni, mentors, projects' administrators, and Google's GSoC administrators discussed challenges and opportunities. I learned that GSoC organizational administrators can email Carol Smith at Google to request possible travel stipends for their GSoC students to attend conferences, and possibly to look at previous mentors' evaluations to decide whether to keep them another year. Also, FLOSS projects report great success with the tactic of requiring applicants to do small tasks to prove they're serious and to set up those students to succeed, and mentors and org admins did not seem to think that this would unfairly weight admissions towards students who were already going to go into open source anyway.
- "Snooze, the Totally RESTful Language": hilarious, because Markus Roberts led it. My dents from the session:
- # In Markus Roberts's #osb11 talk "Snooze, the Totally RESTful Language". Leonard, you never told me REST was a meaningless acronym. BETRAYAL
- # Demo fail. "Anyone here have a laptop?" "What, you want me to go to localhost *for* you?" #osb11
- # "I think there's a market for this, especially if we convince people that there is one." ... "Are you incepting?" #osb11
- # Markus is now just riffing on soaking up consumer surplus, Bitcoin, NoSQL, pig Latin, & the joy of boundaries. #osb11
- Elizabeth Naramore spoke on technical debt (slides). One item that really struck me is her experience that sometimes chipping away at little tech debts won't get you the momentum & buy-in you need. You need a big thought-provoking goal.
- "Inviting Contributors to Open Source Webdev through Virtualization" by Les Orchard told me that not just Dreamwidth, not just Wikimedia, but also Bugzilla and addons.mozilla.org are trying this concept. Four makes a trend! I hope they all compare notes. I also learned of a tool to sanitize real data dumps, to get useful test databases that community developers can use.
In between, I saw new friends and old, talked up MediaWiki, told people about the zillion open positions for which Wikimedia Foundation is hiring, played Dance Dance Revolution, ate great food, and enjoyed the inimitable atmosphere of a great conference.
A few ego-stroking notes: Open Source Bridge's Melissa Chavez also interviewed me for an eight-minute video. And, with Asheesh Laroia and Igal Koshevoy, I was named one of three Open Source Citizens by the conference organizers. Thank you for the honor; I will wear my scarf with pride!
(Thanks to the Wikimedia Foundation for the plane flight, to the conference for letting me in free as a speaker, and to my friends Brendan and Kara for hosting me. Thanks to Reid Beels and John Parker for their photos, which are CC BY-NC-SA. Thanks also to Josh Triplett for his photo.)
# 23 Jun 2011, 10:12AM: Learn Tech Management In Probably Fewer Than 45 Minutes:
I've put up slides and pretty rough notes from the talk I gave yesterday at Open Source Bridge, Learn Tech Management in 45 Minutes. I quote Langdon Winner and then Marx & Engels, summarize the efficient markets hypothesis as "we're not stupid," and give a list of spin tactics you can use to get or keep budget for a project. Audio & nicer notes to come soon.
# (1) 09 Jun 2011, 02:04PM: Portland and San Francisco Travel This Month:
I'm going to be in San Francisco next week for in-person collaboration with my Wikimedia colleagues. Then, June 19-25, I'm at the Open Source Bridge conference, presenting Learn Tech Management In 45 Minutes.
It took me two years to get a master's in tech management. I save you $40K and give you the short version.
Managing innovation, intellectual property and employment law, corporate finance, building a business plan — my master’s degree in technology management gave me some grounding in a bunch of suit stuff. I’ll teach you a little of each of these, plus insights from my management experience and fish-out-of-water anecdotes. Aspiring executives welcome; ties optional.
It would be lovely to have time to hang out with acquaintances and friends in either location; contact me!
# (5) 03 May 2011, 10:40AM: New Job, New Email Address:
As of this month, I'm a full-time contractor for the Wikimedia Foundation, serving as Volunteer Development Coordinator. My boss at WMF, Rob Lanphier, has just posted a welcome note that makes me sound all fancy.
In case you were wondering about my other clients from earlier this year: my paid work on GNOME Marketing, for the launch of GNOME 3.0, has ended, and I've also ended my work as fundraising coordinator for QuestionCopyright.org (passing it on to someone who has more time and relevant experience).
It might be disorienting to only have one job! I shall probably get used to it.
# (1) 01 May 2011, 09:45PM: PICC 2011:
My performance at the Professional IT Community Conference went all right. Consistent light laughter, some long belly laughs and several bits of applause. Sheeri Cabral and Tom Limoncelli really hit it out of the park on Slideshow Karaoke (best practices). Thanks to The League of Professional System Administrators for inviting me, and especially to Matt Simmons and William Bilancio for organizing my attendance and appearance.
A few things I recommended at PICC:
# 26 Apr 2011, 05:14PM: GSoC, GSoC, Who's There?:
As the organizational administrator for MediaWiki (thanks to my job for the Wikimedia Foundation), I am pleased to announce our Google Summer of Code students for 2011.
Also delight-inducing: the number of rejected applicants who hope to contribute to MediaWiki as volunteers. I'm trying to get them involved in their local Wikimedia chapters as well.
# (18) 25 Apr 2011, 06:31PM: Do You Have 90 Minutes To Help GNOME?:
I'm seeking volunteers for a fairly low-effort GNOME Journal task. I need about ten. You don't need any special knowledge about GNOME, just access to email and about 60-90 minutes of free time over the next two weeks. Let me know if you're interested!
# 12 Apr 2011, 03:26PM: Geeky Standup Comedy as Value-Add:
So, about that standup I'm doing this month. Have you perhaps further pondered, "It would be awesome if Sumana performed at a tech conference where I could also network with the IT community of New York and New Jersey, and attend training programs for way cheaper than I could get elsewhere"?
Your wait is nearly over. I will be the evening keynote speaker at PICC, the Professional IT Community Conference, on Friday, April 29th, in New Brunswick, New Jersey. PICC is a nonprofit production of LOPSA, the League of Professional System Administrators. Other (serious) speakers will include Tom Limoncelli, Sheeri K. Cabral, and the sysadmins from StackExchange. Python, Nagios, security, time management, Hudson, IPv6, all sorts of useful stuff.
The student rate is under a hundred bucks. Today is the last day to register at the early rate -- check it out!
(So yeah, all those other performances this month will be to prep for the PICC keynote. Please attend and help me improve it!)
# 11 Apr 2011, 03:38PM: GNOME Contractor Status Update: Launch Week & Next Steps:
(Also posted to marketing-list.)
My last email, on April 1st, mentioned that "my main TODOs today, this weekend, and early next week are to follow up on press contacts, the eReleases blast, and GNOME Journal." So I did that; that day, I got the eReleases press release out, and it went to more than a thousand publications. And then here's a list of what I did last week on GNOME:
- Corralled answers for journalists. A few journalists asked me followup questions after the press release, so I got answers from other GNOME people, wrote answers, replied to the reporters via email and phone, and put these answers on the wiki (Talking Points).
- Managed the GNOME Journal launch. Nagged the last few authors, edited articles for content and style, uploaded them, fought with Textpattern, continued planning to move us to WordPress, and sent out the publication announcement. I'd still love for people to continue publicizing this, since there are many interesting nuggets that I haven't seen picked up by the larger press.
- (Started planning the next two issues of GNOME Journal, including hopes for a 3.x roadmap article in case anyone wants to write it.)
- Did a teensy bit of web testing and feedback regarding gnome3.org. Great job!
- Went to the Linux Foundation Collaboration Summit. There, I talked up GNOME 3 to reporters and other interested Linux folks, and made contact with some KDE people and started talking about publicity for the upcoming desktop summit. It sounds like we should be working to drum up attendance now, by planning special events, trumpeting rare speakers, and publicizing the unique benefits of attending GUADEC & the Desktop Summit.
- Attended the marketing/PR training at the Linux Foundation Collaboration Summit (thanks for setting it up, Dave!). I sure did learn a lot, from strategies for resource-constrained projects (build relationships with five key reporters) to tips for being interviewed. I will link to Cloer's slides and add my notes when she puts them up.
Undone: I didn't put tasks in Bugzilla because they were moving too fast and I was in San Francisco, many timezones away from Allan in Bangalore, and couldn't coordinate effectively. Lesson for next time: do it early if we're going to do it at all. Similarly for setting up interviews with key GNOME developers; I dropped the ball there.
Now that we've launched, I talked with Allan about how to best use the rest of our contracts (we're booked to work on GNOME till the end of April). We think our priorities for the rest of April are:
(a) reach out to not-so-news-driven (more in-depth-reporting) journalists about aspects of the release that didn't get covered on launch day -- once we get some bites, prep developers who have volunteered, and get them interviewed
(b) write up lessons learned & ideas for next time
(c) infrastructure building & maintenance: update the wiki, consolidate audiovisual and textual resources, and otherwise help prep for future marketing, including press releases, talking points, etc. for the launches of GNOME 3 within distributions that will come out in the next weeks & months
So I'm going to make some progress on each of those this week. Specifically, I aim to reach out to two reporters, braindump a few lessons learned privately, and confer with Allan Day and Vincent Untz about resource consolidation. And I'm planning on pushing GNOME Journal's next issue forward, in collaboration with Paul Cutler, but that's not part of my contract since it's not GNOME 3-specific. :-)
# 06 Apr 2011, 01:48AM: GNOME 3 Edition of GNOME Journal Published:
I just pushed the button(s) to put out a new edition of GNOME Journal! This one focuses on the launch of the 3.0 version of your favorite desktop environment (assuming your favorite is GNOME). You can read these now at http://gnomejournal.org:
We publish all our articles under the Creative Commons Attribution-ShareAlike 3.0 license. Please feel free to translate, podcast, repost, etc.
- "Letter From The Editor": Editor-in-Chief Paul Cutler celebrates the release, and discusses innovation, pain, and history.
- "How We Got Here: A Design History of GNOME 3 & the Shell": Daf Harries asks designers Jon McCann and Jakub Steiner the hard questions.
- "PyGTK, GObject, and GNOME 3": I interview Tomeu Vizoso and John "J5" Palmieri about PyGTK, GObject, introspection and PyGObject. What's new, what's been surprising, and what's next?
- "The Two Most Urgent Tasks: Simplicity and a Keyboard": Cathy Malmrose of Linux hardware firm ZaReason asks the GNOME community to solve the two biggest pain points she sees.
- "Fonts in GNOME 3: Cantarell, Tweaking, and Trailblazing": Nicolas Spalinger explains why Cantarell is more than just a font -- it's a symbol of a whole new design process. And he shows you how to tweak the font settings in GNOME 3.
Thanks to the authors, our interviewees, the GNOME sysadmin team, and my fellow editors! And thanks to the hundreds if not thousands of contributors who have put their energy into GNOME 3.
# (3) 01 Apr 2011, 04:21PM: GNOME 3 Marketing: A Snapshot:
The story of this week, for me and GNOME marketing, is primarily the story of a press release. I collected quotes, revised it in response to feedback on marketing-list, added press contacts to our CiviCRM installation and emailed the press release to them (at least twenty contacts, with more to come). It should show up tomorrow on gnome.org once the "we're delaying six months" April Fool's press release runs its course. We're now getting responses from interested journalists and I'll be answering their questions and helping them set up interviews with some key developers.
Also, I heard a success story from another open source marketer about ereleases, so I plan on editing the press release down to 500 words and paying $200 (the nonprofit rate) for their press release publicity service this afternoon.
By the way, in a previous status report I mentioned looking into Collabtive. It's terrible and I won't make us use it. For tasks involving responding to press contacts, we are using CiviCRM. I will be checking with Allan after the hackfest to see whether the remaining tasks would benefit from being placed in Bugzilla; I had aimed to do that before I fell ill.
This week we also had the second User Day. I did not publicize it as far ahead of time as I wish I had, but we did get some participation and answer some users' questions. Thanks to all the hosts!
After a discussion with Sri and Diego, I added "Approaches That Work" to the GNOME 3.0 talking points. If you need to talk with a skeptic about GNOME 3, we're hoping you can get some ideas, tips, and answers to common skepticisms there.
I also did some nagging, editing, writing, and organizing around GNOME Journal's GNOME 3 issue, which we hope to put out this weekend.
So my main TODOs today, this weekend, and early next week are to follow up on press contacts, the ereleases blast, and GNOME Journal. Thanks to everyone in Bangalore who's at the hackfest and working on the release!
# 01 Apr 2011, 12:00AM: Joel On Coal:
Hey, my ex-boss Joel Spolsky -- who said last year that he'd quit blogging -- has started a new blog about coal mining!
The other crucial thing about having a schedule is that it forces you to decide what seams you are going to choose, and then it forces you to pick the least safe corridors and cut them rather than slipping into pillar-robbing (a.k.a. slope creep).
Update: April Fool's! Postmortem.
# 31 Mar 2011, 03:40PM: MediaWiki Accepting Google Summer of Code Applications:
Just posted on the Wikimedia tech blog: MediaWiki got accepted as a Google Summer of Code project, so we're looking for project ideas, mentors, and students. More details at the techblog post.
# 28 Mar 2011, 07:35PM: Ada Initiative Survey:
I just took the five-minute survey on women in open tech & culture (a really inclusive definition). The Ada Initiative is surveying people of any gender in "a wide range of activities and communities based around free/open licenses, and other forms of open, decentralised, and grassroots participation in technology and related fields." If you're reading this and you're not related to me, you should probably go take it. It really does take less than five minutes, and this data is crucial so we can gauge how well we're doing now and how far we'll go in the next few years.
# 28 Mar 2011, 07:03PM: GNOME User Day This Thursday, 31 March:
As Allan put it: There are lots of enthusiastic GNOME users who have questions about the upcoming release, and there are plenty of people who are interested to hear about what GNOME 3 will be like. That's why I'm really pleased to be able to announce the first GNOME 3 User Day. This will be a great opportunity for people to get involved with the new release, to meet members of the GNOME project, and to find out what's in store in GNOME 3.
Well, that was for the first User Day. The next one is this Thursday, March 31st, in the #gnome channel of the GIMPNet IRC network. (Instructions for using Internet Relay Chat.) We'll be running three sessions over the course of the day (all times UTC):
Session 1 (07:00-08:00): Participate in the GNOME 3.0 hackfest
Hosts: Allan Day, Fred Peters, and Andre Klapper
Session 2 (15:00-16:00): The GNOME 3.0 platform
Hosts: Diego Escalante Urrelo and Luis Medinas
Session 3 (20:00-21:00): GNOME Shell Q & A
Hosts: Florian Mullner and Marina Zhurakhinskaya
I hope you'll join us! We'll be concentrating on those topics but feel free to drop in and ask about anything GNOME.
I used a photo from Sajith T S, CC BY-SA, of a park and fountains in Bangalore, because I hope we get a big crowd, because this User Day coincides with the Bangalore hackfest, and because information from friendly experts can be as welcome as water on a hot South Indian day.
# (2) 22 Mar 2011, 08:45PM: A Slightly Disjointed (Due To A Five-Day Cold) Musing On Open Source, Fear, Motivation, And Witnessing:
I was introducing C. to a set of QuestionCopyright friends and acquaintances, and they were joking about indoctrinating her, and she was curious to hear what free culture is all about. So she wondered why I reflexively suggested that the others wait a bit, tell her next time.
They did give C. the introductory spiel, and conversation was pleasant and edifying, and nothing terribly awkward ensued. She has developed a substantial interest of her own, now, in the theory and practice of free culture. But why did I have that reflex? I felt around for it and grasped something. It makes it harder, I said, once you know these things and care about them. Becoming a free culture/free software person is like becoming a vegan.
No, G. replied -- at least people know what vegans are.
We happy few.
Here I was, a fulltime free culture/free software consultant, feeling an unaccustomed reluctance to give someone else the sunglasses, to witness.
There are self-constraining ideologies like veganity or chastity that modern society at least theoretically understands, even if some cohorts scoff. Then there are the practices that always require an introduction. When I explain how I met Leonard, I often start with the thirty-second "what is open source" explanation, because it's all of a piece. But my "what is open source" intro focuses on pragmatism -- many eyes making bugs shallow -- rather than free software values.
I think I'm a moderate sort of open source gal, an ovo-lacto vegetarian. There's an iBook running Mac OS tucked off in a drawer, and all these Linux boxen in our house surely have nonfree binaries driving bits of hardware. No Facebook but I surely use many cloud services that violate the Franklin Street Statement. I hang out with copyright abolitionists, Debian users, and other free culture/free software folks who make me feel namby-pamby. And then I go to dinner with someone who makes me feel like a Jain. Or I find myself saying, as I said a week ago, that developing on a closed platform is like trying to fall in love with someone who won't talk to you.
Our love is part of what energizes us, moves us to act. In FLOSS, volunteers do things for two basic reasons: either because we enjoy doing them for their own sake, or because the task needs doing and we want to do our bit. We see some goal the task will help us reach, or fear an outcome the task will help us prevent. [By the way, it's useful to have experienced that, because it's useful to assume those two as the means of persuasion whether my colleague's paid or not. As a leader, I should either set up tasks people will genuinely enjoy (and get the scutwork out of the way), or help my colleagues see a straight line from the task to a glorious future. Show them how what we're doing leads to something they want. This is my pet theory of How To Lead Knowledge Workers and your mileage may vary.] And -- as a zillion social scientists will tell you -- even if we momentarily burn out on caring about a goal for its own sake, we don't want to let the team down. We don't want to let our buddies down.
As we were talking about GNOME marketing, Andreas once asked me what I found special, what personally spoke to me about GNOME. I rambled: object code is compiled from source code, but the source code is compiled, too -- compiled from people, from time, from love. Every time I look at my desktop, every feature and every bug comes from someone, someone with a name and a face, and sometimes I can even remember. Hey, I remember when she added that feature to Empathy. Oh, right, I know he's working on that bug. It's like all of Planet GNOME is helping me out, every day. It's like my whole community's right there, on my desktop, every time I open the laptop lid.
I don't want to keep my friends blissfully ignorant of this. Is there a more loving human impulse than the joy of sharing? I'm sorry, C. I'm sorry I was afraid of making your life harder. I remembered the local minimum and forgot the greater maxima awaiting you. Why keep us a "happy few" when we can be an ecstatic many? And yes, it's harder, to learn our principles and try to walk this path alone -- but the whole point of our principles is that our multitude, our diversity, our union, our communion is far richer and more sustaining than individual hoarding ever could be.
# 15 Mar 2011, 01:24PM: New Edition Of/Nueva Edición de GNOME Journal:
In this special edition of GNOME Journal, GNOME HISPANO's Juanjo Marin arranged for us to get five great stories in both English and Spanish. You can read these now at http://gnomejournal.org:
The GNOME Journal features original content and commentary for and by the GNOME community. All articles are published under the Creative Commons Attribution-ShareAlike 3.0 license. Please feel free to translate, podcast, repost, etc.
Thanks to Juanjo, the authors, Diana Katherine Horqque, Will Kahn-Greene, Sriram Ramkrishna, and Paul Cutler for their work on this issue!
Issue 23 will come out around April 3 and focus on the release of GNOME 3.
# (2) 08 Mar 2011, 02:59PM: Writing, Delegating, Researching: Marketing GNOME 3:
Allan and I discussed some near-term priorities today in #marketing, so I'll document them here (and on the marketing list).
Allan this week is concentrating on release notes. He feels he has a good handle on what to write for the user side, but would like more input on what's changed for developers, so he wants advice/contacts on how to get that. I've suggested he do a session in #gtk+ or some other popular IRC channel and crowdsource some rough bullet points. He's also working on the Porting Guide -- as of today, he's working with Shaun McCance and the docs team. (This is part of our marketing to distributions.) We're hoping to coordinate with the docs team on this during their May hackfest.
He's already blogged/emailed what he's done so I won't rehash.
Sumana: Between my last note and now, I chased distribution marketing, clarified the role of the release roadmap, started a press release, got a CiviCRM account and started accumulating press contacts, chased video from launch parties and restarted the conversation about GNOME 3 videos, communicated & thought with Brian and Allan about promoting FLOSS and not promoting unfree software, reached out to potential volunteers (including on foundation-list), and recruited and edited articles for GNOME Journal's Issue 23 (GNOME 3.0 issue). And then today Allan and I hashed out some priorities in #marketing.
This week, to balance Allan's focus on two big things, I intend on doing a lot of smaller things.
This is a lot and so it might change if more pressing matters come up, but I think it's a good place to start. Thanks again, GNOME community, for the opportunity to work on this!
- Get into CiviCRM and input our press contacts, start seeking the ones we want but don't have (Ars Technica, Wired, TechCrunch, O'Reilly online) in collaboration with Zonker
- Continue drafting 2 press releases, 1 for a Linux-specific crowd (like LWN) and one for a more general tech crowd (like Wired)
- Try out the GNOME install of Collabtive and see if Allan and I should switch our task management to that, or to Bugzilla (trying to track tasks in live.gnome wiki tables is not my idea of pleasant)
- With a little input from Allan, start setting up another GNOME User Day for late March
- Ask Licio to chase marketing localization
- Continue recruiting and editing GNOME Journal's GNOME 3 edition
- Reach out to docs team and other potential volunteers
- If I have time, chase videos/screencasts
- If I have time, some wiki cleanup
(photos from last year's marketing hackfest in Zaragoza, Spain)
# (1) 02 Mar 2011, 10:03AM: Yahoo! Labs Research Presentations, February 2011: Part I:
This year, Columbia WICS let me come to another Yahoo! Labs research presentation/lunch (last year's notes). Thanks for the invite, Elizabeth Kierstead. My writeup begins here!
Schmidt of Academic Relations started off by talking about all those other industry research labs and their SAD DECLINE. Bell/Lucent/Alcatel, AT&T Labs --
he'd seen them wither into irrelevance. (Despite that awesome Bell Labs Innovation song.) But Yahoo! Labs, started in 2005, is evidently hella relevant and vibrant. [Update: see comment below for clarification.]
Schmidt discussed the various groups within the labs, including Advertising Sciences or "AdLabs,"
which seems new. As he put it, there's a disconnect between the number of dollars spent on ads and how much time people spend clicking on them. (*cough* social media *cough*)
The recruiting bit: you can pick which lab location to work in. They have a research
lab in Haifa! And Schmidt assured us that Yahoo is woman-friendly, led by CEO Carol
Bartz and featuring 500+ women in Yahoo's women's group. Mostly the same spiel as last year,
including Schmidt's reminder of the Key Scientific Challenges program that gives grad students money, secret datasets,
I have the phrase "'billions & billions' of pageviews, etc." in my notes here and assume it's because Schmidt was pointing out how much data Yahoo! folks
get to work with, and what a huge impact they make.
Then: student intros! There were about ten of us there, mostly grad students. Their interests ranged through social networks, data mining, spoken and
natural language processing, privacy & security, compilers for heterogeneous architectures, and economics.
First presentation: Elad Yom-Tov's and Fernando Diaz's
"Out of sight, not out of mind: On the effect of social and physical detachment on information need". Let's take three example events: the San Bruno gas
pipeline explosion, the New York City tornado, and the Alaska elections. People might be interested in searching for information about them because they live
nearby, or because they have friends who do. So you measure physical and social attachment/detachment: physical distance and number of local friends.
What data did they use? The query log: userID, time, date, text of query, results, what they clicked (with term-matching, inclusion + exclusion). The
location data: the ZIP code the user provided during initial registration. I'm skeptical of that but the researchers say it's fairly reliable, although "more
than we [would] expect live in Beverly Hills." And the social network: the number of instant messaging contacts you have who live in the relevant location.
There's a strong correlation with physical detachment, an exponential fit. As for the social network: the more local friends you have, the more likely you are
to ask Yahoo! about the event. Beyond 5 friends, the data is noisy, and we don't have a lot of data there, but overall it's a very nice fit, strongest with the
San Bruno data. And if you're local, you have more local friends, but that isn't strong enough to explain what we see.
In terms of time: attention span is limited. People's attention wanes after about three days.
The researchers compared people's queries along the social and physical distance axes, looking for unusual phrases -- phrases that trended up around the
dates of the incidents. If searchers are physically close to the incident, whether their friends live there or not, they use the same words. Like, for the NYC
tornado: queens, picture, storm, city, nyc. If they're physically far away but have friends in New York, they use terms like brooklyn. [Also
mentioned: new(s) and york, but that might be a stemming fail.] But a term that people both physically and socially detached from New York City
searched for: statue of liberty. Is that grand lady all right after the tornado? America wants to know! (Yes.)
(The presenter then spoke about clustering queries by words, since different words signify different informational needs, but this bit had pretty bad graphs
and I didn't understand.)
So Yahoo! wants to learn to identify relevant querier. "Pacific Gas & Electric" is a legitimate query that people search for on any given day, but it would
be possible to programmatically tell that it has a lift due to current news. So Yahoo! wants to act relevantly. In the PG&E example: most days, the search
result is and should be the PG&E homepage, but on that day, a top result or sidebar should be a news item about the explosion. A more abstract way of saying
this: "learn a retrieval mode for each detachment level." Using social knowledge gets ranking results that are better than just geotargeting -- the difference
is statistically significant -- and better even than combining a person's geographic and social detachment levels. "There's a problem with 'both,' probably
because of the way we trained our models."
Previous studies suggested that the further a news source is from where something is happening, less likely the news source is to report the event. And
Yom-Tov & Diaz's work bore this out. News as a function of distance drops exponentially, as do tweets. Interestingly, when you look at the temporal spike
orders (which came first?) on Twitter mentions/searches, the Yahoo! query log, and mainstream news coverage, you see different spike orders for the different
events. Sorry, I don't have more details, but I bet the researchers do.
One interesting side effect: we can look at people's queries and infer their location (although you can of course usually also do that with IP addresses).
You can even track a hurricane by tracking where the queriers are over time.
These take a while to write up, so I'll save David Pennock's microecon research overview, Sebastien Lahaie's "Advertiser Preference Modeling in Sponsored
Search," and Sharad Goel's confidence calibration project for later posts.
# (5) 02 Mar 2011, 04:54AM: Wikimedia:
Now that my new bosses have told the world: yes, I'm also now consulting for the Wikimedia Foundation, the nonprofit that supports Wikipedia and other free knowledge initiatives. To grossly simplify, I'm coordinating software development (mostly MediaWiki improvement) that isn't by WMF staffers, primarily concentrating on the upcoming Berlin hackathon and this year's Google Summer of Code participation.
Thank you, nostalgia: in December, I was looking up my old high school classmate Christine Moellenberndt, and discovered she was a new hire, then looked at the current job openings, and applied.
I told my mom about it and it went something like:
"Mom, I'm working for the nonprofit that does Wikipedia! ... No, not them, they're different. Wikipedia is a big free encyclopedia that's online for anyone to use. Wikileaks is a ... well, they're a bunch of people who like to get and publicize secrets -- anyway, that's not us."
And no, this holiday season my photogenic face will not be on banner ads entreating you to give. As far as I know.
# (1) 26 Feb 2011, 09:52AM: Careering:
Since I last mentioned my career, I have turned into a consultant. I have a few gigs; let me tell you about two of my clients.
QuestionCopyright.org is a nonprofit that aims "to educate the public about the history of copyright, and to promote methods of distribution that do not depend on restricting people from making copies." I'm QCO's Fundraising Coordinator, meaning that I write and coordinate grant proposals. I also write a tiny bit for the QCO website. Case in point: "Three glimpses: Transformative work, public domain music, and ethics".
The GNOME Foundation, the nonprofit that supports the GNOME desktop, has hired me as one of two contractors to manage marketing for the launch of GNOME 3.0. Allan Day and I will be (to oversimplify) ensuring that Linux users know what's new in this release and why it's awesome.
More on those and my other work when I can!
# (1) 09 Feb 2011, 12:34PM: Recruiting:
As you might have seen from my microblogging, I seem to know a lot of firms that are hiring. In short: I know people who are looking for project managers, UX designers, backend developers, undergrads who code, playtesters, kernel & mobile hackers, so if you know me at all, feel free to contact me to ask for an introduction.
Wikimedia, the foundation that supports Wikipedia ("No, Mom, not Wikileaks, that's different"), is looking for lots of engineers (deadline in 2 days) and fundraisers/researchers/analysts/more. The Volunteer Development Coordinator role also has a 11 February application deadline: attention, open source community managers!
Get paid to hack Linux mobile and save vendors & developers from constantly reinventing the wheel at Linaro. They especially need kernel and Android hackers and technical project and product managers.
OpenPlans, the New York City nonprofit that uses technology to make cities better, has decadent offices and benefits. Oh, and they're looking for a web designer, two engineers, and a fundraising manager.
Socialbomb, the Brooklyn startup that creates stylish experiences connecting Blu-Ray and mobile devices to Facebook & Twitter, is looking to fill several roles, including development.
I'll be administering some Google Summer of Code work this year, so I'd like to recruit bright university students to consider applying. It's never too early to start thinking about summer internships! And don't worry too hard about qualifications: "Do you have some programming experience at the university level? Then, yes, you are good enough! No, you don't need to be a Computer Science or IT major."
And I know at least one more project that's looking for a part-time playtester and a part-time project manager, so let me know if you're interested.
# (1) 02 Feb 2011, 10:50AM: Is Our Sumanas Learning?:
Yesterday + today:
Project Hamster is a nice timetracking app, better for my purposes than is gTimelog.
The magic code to add to an HTML page to make RSS autodiscovery work: <
link rel="alternate" type="application/rss+xml" title="RSS Feed" href="/rss.xml">
What domain name to use, and thus how to construct an email address for email-to-SMS on my phone.
Where the downloadable gzipped archives link is on mailman archive pages (example). On the right, right under my nose; no need to cast about and start constructing a
# (3) 01 Feb 2011, 08:47AM: When Am I Ever Going To Have To Use This?:
Yesterday, while negotiating with potential clients, I used:
- You know, standard reading, writing, and interpersonal speaking skills (many courses, school newspaper, speech & debate, Academic Decathlon)
- Basic algebra to work out some price quotes (elementary school math classes)
- US and world geography (K-12, history classes)
- The wheelbarrow anecdote from Benjamin Franklin's autobiography to make a point about open source contributions as a marketing tool (eleventh grade American Literature)
- Political science concepts of authority and legitimacy, in determining a client's needs regarding open source leadership (college)
- Knowledge of Unix-style design (started in college, especially at the Open Computing Facility)
- The innovation S-curve, and cautionary tales of platforms that never got uptake from customers and vendors (master's in tech management)
All that school comes in handy sometimes!
# (2) 10 Jan 2011, 11:17AM: What's Obsolete & What's Still True?:
In India the number of institutions and organizations installing computers is growing at a rapid rate. This is a welcome sign. More and more of our workers in factories and offices will now turn the monotonous and routine jobs over to the computer, and thus will be cured of the nervous tension which they suffer unconsciously day in and day out. These workers, thus rendered healthy, will be an asset to the country and will devote themselves to more challenging tasks which need the ingenuity of a human brain.
From Essentials of Computer Programming in FORTRAN IV, Nripendra Nath Biswas (Indian Institute of Science), Radiant Books, Bangalore, India, 1975. Page vii; second paragraph of the preface.
My mother knew FORTRAN; she used it, she tells me, in a night job doing data entry at a nuclear power plant. Her FORTRAN teacher said she was awesome and encouraged her to go into programming fulltime; she declined because she didn't want full-time daytime work, or already had a day job. I wonder how my life would be different if I'd grown up with punchcards.
...Where do we write these statements and how does the computer read them? It is quite obvious that writing these statements on a piece of paper and holding it in front of the computer will not solve the problem. (At least not right now. The computers of future generations will surely acquire this capability.)... -p. 33
Considerable research is under progress to improve the capability of a programming language, so that it can itself correct certain types of errors. Even then it is obvious that a programmer will need a more rigorous knowledge of the language to write a computer program than the knowledge of French that an English speaking tourist needs when shopping in Paris... p. 52
Je voudrais un silver bullet!
# 23 Dec 2010, 03:01AM: A Turn From The Personal To The Professional:
I'm seeking a new position as a project manager or open source community coordinator. From here I'd like to get into product management with a sideline in mentoring engineers in career development. Resume, LinkedIn, email, homepage. New York City preferred; will also consider Boston, San Francisco Bay Area/Silicon Valley, and the United Kingdom.
# (3) 12 Dec 2010, 08:02AM GMT+5:30: FOSS.in:
Anyone going to FOSS.in in Bangalore in a few days? I'm thinking of attending on December 15th, the day before I fly back to the USA. Perhaps we could hang out.
# (8) 04 Nov 2010, 02:26PM GMT+5:30: To Build A WiFire:
Nandini advised me that video chat with her fiance makes it far more bearable to be away from him, so I decided to investigate the Google Chat videochat integration in Empathy so I could videochat with Leonard for free without having to install anything proprietary (read: Skype). It worked fine between my and Leonard's Ubuntu machines when we were in the same apartment in the States, but my Empathy froze up when I tried to initiate an audio or video chat from here in Mysore. That was just over wifi, though; it kinda worked when I plugged into an Ethernet cable. Kinda. (I hereby apologize to my former coworkers and the GNOME community for not actually making efforts at debugging this yet; I may poke at it soon.)
Over two days, my pal James A., a sysadmin who lives in Perth (Western Australia) and thus inhabits a time zone suddenly much more congenial to random conversation, spent at least 90 minutes on the other end of the notional line, helping me work out a few hitches and exchanging the most boring possible text and audio chat with me. "I can't hear you." "Oh, my mic was muted." That sort of thing, interrupted of course by talking about themes in Snow Crash and The Diamond Age.*
From the middle of that: "OK, now your face is just a bunch of blocky squares." "Yeah, that's a natural consequence of aging. I learned that from moisturizer ads. If you don't use Oil of Olay then your face gets all pixelated."
From the end of one troubleshooting session:
Sumana: Well I think we've all learned a valuable lesson today
Sumana: and that lesson is, never make a friend who does not live in your postal code
Sumana: and never leave said district
James: or take them with you
Sumana: Katamari them on up
It was around then that, while out on an errand, I thought I'd buy a longer CAT-5 (Ethernet) cable, since the one I had wasn't long enough to snake to my room from the router. So I walked to the computer-stuff shop a few blocks away.
"I need to buy an Ethernet cable. Do you sell them?"
We clarified that we were talking about the same thing. I shoulda just said "CAT-5."
"What length do you want? One meter, five meters?"
"What do you have?"
"What length do you want?"
"Just tell me what you have. What's the longest cord you have?"
"We have all lengths, which do you want?"
I sighed, said I was bad with meters, and estimated I wanted about 30 meters' length. That's when he went into another room and got out the mega-spool of CAT-5 and the hand-held crimper.
Oh. If only I'd brought my crimper! I knew how to do this, once!
Rakesh cut off some insulation, got the wires in order (asking me what I meant to do with the cable so as to check crossover vs. patch), cut off the extra wire length, pushed the wires into the connectors, and crimped them into place. Then he tested the cord with a handheld device and frowned, then cut off one of the ends and started again. After this had happened a few times, we commiserated about Rakesh's inadequate crimper, which wasn't forcing the wires all the way into the connector with a nice click. I ended up going home and coming back for it an hour later, after he'd switched crimpers. Cost: 365 rupees (50-rupee crimping fee plus 9 rupees a meter), or about USD8. Carrying a 35-meter coil of CAT-5, tied with a couple pieces of string, on my shoulder down a muddy Mysore lane made me feel an authentic part of the Indian tech scene.
What also made me feel authentic was coming home to discover that construction workers a block down had accidentally cut a line while digging and my household had neither landline phone nor broadband. The next day, Mom called The Guy She Knows at the telco, who came down and fixed it. I tried to talk with him in my incredibly broken Kannada plus Internet-related nouns. Sample, translated for sense into English: "Yes, cell phone, 3G, AirTel, it is. Right now, wifi do." He told me that WiMax has successfully launched in Kerala and is coming to Mysore, which led me to ask excitedly, "Mysore WiMax ya-wa-ge?" or "Mysore WiMax when?" which sounds like I'm some sort of Wired-reading Conan the Barbarian. About 15 days from now, apparently.
His colleague didn't speak as much English, so when I mentioned that I lived in New York City, this got reiterated/translated as: "She lives in America. New York City. A very big city. There was a bomb. [hands sweep across each other, like buildings falling down]"
"Yes, that's where I live," I agreed quietly.
I got to see a minuscule slice of that city yesterday, when I videochatted with Leonard.** (For now it's soundless video + a plain telephone call for audio; more troubleshooting is in our future.) A less sweatshoppy laptop, some open protocols and FLOSS software, a friend's help, a bespoke Ethernet cable, innumerable components and stories and wires and decisions forming the infrastructure of the digital world, all so I could pretend to be a crab clacking my claws at my husband. Nandini was right.
* I mentioned that Stephenson is obsessed with how to best arrange for institutions to keep going past any one member's death, and James pointed out Uncle Enzo's career and his disdain for the Young Mafia. Also, when James mentioned that WordPress is written in PHP, which is really itself a CMS, I called WordPress "an unstable sedan chair atop a drunken Godzilla," which I don't stand by, but which is funny anyway. WordPress is more stable since I last had to work with it and I shouldn't be so hard on it, especially since they folded the great WordPress MU back into trunk. I am curious about Melody, though.
** "Just so you know, since I introduced you to Beth and Pat and Lucian, I expect a commission." "Oh, okay. Some kind of friendship commission?" "A blue-ribbon commission." Plus me listing off a bunch of names and him adding one more. What do these people have in common? Randall Munroe, Vienna Teng, Jonathan Coulton, Ken Liu, Charles Stross, Darcy Burner, Seth Schoen, Vernor Vinge, Ellen Ullman, Joel Spolsky, Eric Sink, Ryan North, Neal Stephenson, Paul Graham, John O'Neill, Naomi Novik, Kristofer Straub, Leonard Richardson, and arguably Jerry McNerney.
# (2) 26 Sep 2010, 04:14PM: Why I Haven't Replied To You:
I haven't explicitly said this before, but: I'm spending a lot of my time taking care of my mother. Since my dad died this summer, she's needed a little looking-after. If I haven't responded to your message, that's why, and the situation will probably continue until early next year, at which point I hope to be a responsible member of the GNOME, geek feminist, and other communities again.
(I'm in New York City right now but plan on traveling a lot this fall to be with my mom.)
# (7) 23 Aug 2010, 09:45PM: Two Tips On Convincing Managers & Executives To Invest In Your Technology Projects:
From a years-old job-advice email to a friend. The sort of knowledge that Rachel Chalmers or Karl Fogel finds obvious but that some of us still haven't quite integrated into our day-to-day communications and long-term strategies:
You need to be able to express your suggestions to your boss in terms of financial incentives and losses.
A few things I've picked up during a recent class in "Technology in the Business Environment" (when I was doing the master's in tech management at Columbia):
I) Management focuses on the things that drive the organization (directly making money), and tends to ignore things that support the organization's drivers. If you're directly making money, lowering the cost of producing the product/service, increasing management's control, increasing product quality, increasing the knowledge available to an important decisonmaker, or improving customer service, you can describe your work as a driver. Can you find a way to describe your high-level TODOs in one of those ways?
II) Here's a model of management's priorities for technology investment. The higher up this list you can get, the more attention you can grab from management.
- Revenue. Guaranteeing a financial return. Not just cutting costs, but actually MAKING money from customers.
- Increasing scarce productivity. If the demand for a product exceeds the supply, then this is attractive. [1 and 2 indicate that the company is growing, and interested in the future. A good sign!]
- Cutting costs. More popular in a struggling company.
- Competitive advantage -- this means the company is already behind its competitors and has lost first-mover advantage.
- Tech for the sake of tech -- pizzazz and leadership.
So can you explain "creating system-monitoring scripts, streamlining processes, and installing and configuring new programs on the server" so that they're way up on that list?
Let's say a system-monitoring script would take your service from 95% uptime to 99.9% uptime. That's #2. Maybe one of the high-level tasks you do will make it possible for your company to serve twenty units instead of fifteen (#2) or even start a whole new line of products (#1). But "It's more elegant/technically correct" is #5.
I welcome comments, tips, examples, disagreement, and cake.
# 22 Jul 2010, 03:11PM: Announcement:
I've had a family emergency and will be intermittently away from the net for a few weeks. I will not be at GUADEC and I will not be part of DebConf.
# 04 Jul 2010, 10:50PM: GNOME Journal: PHP-GTK, Shotwell, Nokia, & More:
While I was gallivanting around to conferences, a new GNOME Journal came out, shepherded by new Editor-in-Chief Paul Cutler.
Enjoy! The Shotwell piece is useful (Shotwell now joins gthumb & F-Spot in my Apps menu) and the Gil interview is thought-provoking. I'll recuse myself from praising Paul's letter and my interview.
- Paul has his first Letter from the Editor.
- Stormy Peters interviews Quim Gil of Nokia.
The GNOME community has been pushing plenty of brilliant ideas and concepts that now exist as key pieces of software in the free desktop stack. There is an ongoing consolidation process to establish the main platforms of the next years. We believe MeeGo will be one of them: what other strong alternatives are there closer to GNOME?
- I interviewed Elizabeth Smith, maintainer of PHP-GTK.
PHP-GTK is generally best suited for situations when you already have a lot of developers (or a lot of logic) already tied up in PHP. It makes it easy to whip up a desktop interface to that business logic without the need to expose that logic via a service or learn a new language. Personally, I got involved in PHP-GTK just to learn desktop programming. I didn't want to learn a new paradigm (web to desktop) and a new language at the same time. I started PHP-GTK to learn desktop programming without learning a new language... and ended up learning C and being the PHP-GTK maintainer. Funny how that happens.
- Jim Nelson introduced and described Shotwell, a new photo manager for the GNOME desktop.
This brings up one of the features we're most proud of, our auto-enhance tool. We considered various algorithms and performed qualitative testing of photos enhanced by different applications. After a few tries, we landed on an algorithm that gives great results most of the time. (We've yet to find an auto-enhance that improves every photo.)
Our algorithm involves analyzing the photo's luminescence, dropping the outer points of the distribution and boosting the middle ranges to expand the contrast of the image, making it punchier and more vibrant. If a fair portion of the photo is dark, the shadows are lightened to bring up detail.
# 24 Jun 2010, 03:40PM: The Second Step: HOWTO encourage open source work at for-profits:
At the excellent Open Source Bridge conference earlier this month, people seemed to enjoy my talk. The one-liner:
Even at pro-FLOSS businesses, logistical obstacles and incentive problems get in the way of giving back. I’ll show you how to fix that.
My session notes are now available. If you were there, please feel free to clarify them and add your notes or links to your notes elsewhere.
The very short version: a company does not upstream its patches, even though it should for long-term practical reasons, because of problems in four general categories. The company might lack a FLOSS culture. There might be legal confusion about what employees are allowed to do, and how to get permission. The project management workflow and timelines might not allow time for proper engineering. And the external project might have a terrible UI for new contributors.
Once you abstract these categories away from the specific problem of accidentally hoarded code rotting away, you see that they also apply to other problems of the type "I really know I should be doing foo but haven't gotten around to it."
I also added notes from my lightning talk on Thoughtcrime Experiments, in which I inadvertently invented a new social media marketing technique.
# (1) 17 May 2010, 04:40PM: Snort, Chuckle:
So I was watching a bunch of DJ Earworm mashups and saw this on my screen:
What do you notice there? Perhaps this ad?
We love freedom of choice
Amusingly, if you actually go to www.Adobe.com/Choice/, you get a Page Not Found. "Choice" is case-sensitive, you see.
Why we don't support restrictions on creativity and innovation.
As I knew before I clicked, this is a Flash-related Adobe vs. Apple salvo. Sorry, Adobe, I remember Dmitry Sklyarov.
# 10 May 2010, 10:06PM: Zaragoza GNOME Marketing Hackfest, Day 3:
On Thursday, 6 May, the last day of the hackfest, we got so much done! (See Paul's photo). The "we" here came from three continents: Daniel Baeyens, Stormy Peters, Jason D. Clinton, Vincent Untz, Andreas Nilsson, Paul Cutler, Bharat Kapoor, Licio Fonseca, Ryan Singer and I came from both Americas and Europe for the GNOME Marketing hackfest. I'll quickly recount what we worked on that third day, though I know I'm missing some people and accomplishments.
On Thursday morning, Andreas, Paul, Licio, and Vincent worked on technical ideas for making it easier for people to demonstrate GNOME in live presentations; Paul will be writing more about that. Paul, Stormy, Ryan and I made plans to help GNOME community members learn to more effectively promote GNOME in their other technical communities (a simplification, sorry), and polished the wording of some key talking points for GNOME 3 (usability, accessibility, and apps). Thanks to the #gnome-hackers and #gnome denizens for telling us about apps and components users will love in GNOME 3, like gEdit collaborative text editing! Jason was laser-focused on video-making and giving other GNOME folks the information they need to make GNOME 3 demo videos.
Bharat spoke with me about brochure tactics (for example, every brochure should have a dedicated landing page on the gnome3.org website) and some branding
issues (sometimes, multiple possible names are pretty much equally suitable, and the important thing is just to choose one and stick with it). He and I also
discussed integrated marketing strategy. After all, marketing is a tool to get products or organizations things that they want -- such as sales, brand
awareness, adoption, feedback, etc. -- towards a goal. Because this hackfest was pre-scoped as a GNOME 3 launch planning hackfest, we didn't rehash earlier
GNOME discussions about goals. Still, at some point in the future (perhaps as part of the GNOME 3 post-launch review?), it might be nice to do some limited
planning exercises to deepen our understanding of our goals and resources.
After lunch, we spoke about how to give Linux distributions the information they need about the innovations in GNOME 3, and the assistance they need to talk with their users about GNOME 3. We clarified and added to the GNOME 3.0 launch marketing schedule (feel free to grab one of those tasks).
As we wrapped up, we talked about continuing to work with the Zaragoza municipality and free software community; for example, since the area is doing so much work with accessibility, perhaps an a11y hackfest would be great for GNOME and for the local community. And we did a quick post-hackfest review of what we'd liked and what we'd like to improve next time. For example, using Gobby, the wiki, and IRC to document our discussions and work product as we went was good, but it would have been even better to use IRC more throughout (when possible) to let the larger world of GNOME and GNOME marketing know what we were up to, and to get their ideas.
Stormy finished the day by telling us that we'd gotten more done than she'd hoped, and that she was happy that people had stepped up to make things happen (once in a while she got to just sit back and watch!). She especially appreciated the Spanish people, such as Daniel Baeyens, Agustín Benito Bethencourt, and Ignacio Correas, who had taken so much time to work with us and show us the city. And Stormy thanked us for taking time away from work and home to come to Zaragoza.
That night we pub-hopped, and the next day I got on the train back to Madrid and flew back to the States. You'll see some more details pop up over the next week, on blogs or over on the wiki or the mailing list. I still have to write up some details from our notes. But for now I want to thank the hackfest's sponsors:
# (1) 10 May 2010, 10:29AM: GNOME & Conference Planning & Writing:
I'm back in New York City. Big priorities this week include:
# 06 May 2010, 09:30AM GMT+1: GNOME Marketing Hackfest 2010, Day Two:
On Wednesday morning, starting around 9:30, we broke into small groups to work intensively on video, GNOME Ambassadors, and the website. For example, Bharat,
Vincent, and I started a business card template for GNOME Ambassadors, and Licio, Ryan, Stormy, and Bharat worked on the Ambassador brochures and website.
I had planned on starting some group discussion and knowledge sharing when the momentum lagged in the late morning. But it never did! So our first real
break happened when Jose Felix Ontanon and Juan Jesús Ojeda Croissier joined their fellow Seville technologist Lorenzo Gil Sánchez to talk with us about
accessibility work in the Andalusia region of Spain.
We did make a lot of progress in the morning: a GNOME 3 website mockup, a marketing brochure template, four video scripts, Ambassador website text,
preparations for the 5-minute topic presentations, and other useful discussions and writing/communications.
After a lunch with them and with local officials and community, we heard a presentation from the city regarding their Digital City initiative. Some interesting facts:
- The proposed Art and Tech center will include four Fab Labs (as part of a hackerspace/business incubation strategy)!
- About a third of Zaragoza's university students are doing technical degrees.
- Open broadband plans include a Wi-Fi mesh network with free access in strategic public places, plus WiMax for municipal use.
- Additionally, a low-cost citizen's card will give Zaragoza citizens access to more Wi-Fi, plus city bicycles.
I believe another hackfest participant will be linking to that presentation pretty soon. After that, Paul & Stormy met with the Spanish a11y mavens to talk
about how GNOME can help the community & municipality get the publicity & feedback they need to make their FLOSS a11y & GNOME initiative a success, and talked
with Vincent and the local municipality about similar possibilities. (Whew!) Jason tackled some screen-recording issues. Andreas designed an SMS fundraising
card for Bharat's proposed SMS fundraising initiative, and began designing the brochures that Bharat, Vincent, & Ryan continued writing, and Licio is writing
GNOME Ambassadors material. I turned the next 2 months of GNOME 3 launch TODOs to http://live.gnome.org/ThreePointZero/MarketingRoadmap and people who want to grab ownership of
or ask about a task should pipe up on IRC or the mailing list!
So our afternoon was pretty full. Even though the hackfest was supposed to end for the day at 7pm, people stuck around till the building closed 90 minutes
later! I threw together some plans for tomorrow; we still need to have certain
substantive discussions, and to make certain execution plans.
The Zaragoza and Aragon governments kindly picked up our lunch and a dinner at Birosta. The three vegetarians in
the hackfest especially enjoyed a meal full of vegetables and free from anxiety.
I again want to thank all the organizations that are sponsoring this event: the Zaragoza Municipality, the Aragon Regional Government, the GNOME Foundation, the Technological Institute of Aragon, ASOLIF and CESLA. Also, the GNOME Foundation covered much of the cost of my travel here. So, thanks!
More reportage tomorrow...
# 05 May 2010, 07:49AM GMT+1: GNOME Marketing Hackfest (Zaragoza, Spain), Day One:
Yesterday we officially started the GNOME Marketing
hackfest, centering on planning the release of GNOME 3.0 on 29
September 2010. Paul Cutler started us off by talking about goals
for the week. He wants us to blog about what we're doing, and to
take care to recap action items and follow up after this hackfest to
execute them well.
Stormy Peters noted that we have a great, diverse set of skillsets in
the room. The last hackfest did a lot of groundwork and generated a lot
of ideas and action items. This time, we want to get a lot of
immediately useful things *made*.
Paul recapped the November
marketing hackfest, which Jason Clinton and Stormy Peters blogged at the time.
What's GNOME 3? (more details below)
Our marketing for GNOME 3: concentrating on existing users. We're talking to our base.
We wrote talking points on the wiki.
Lesson learned: make sure all our marketing assets have a blank space for downstream distributions to put their assets.
We created FAQ text (but need art/design for it), wrote brochure text,
and created a presentation template; we need to wrap all that in a GNOME
We need our own community to buy in to GNOME 3 and spread the word that it's useful and a great upgrade. Module maintainers, GSoC students, etc. already are spreading some word, but is it a positive message? Virality
would be great, so we should make the assets rebrandable, do the videos and disseminate HOWTOs.
I asked for a reminder of the GNOME mission: accessible, free, localized. We offer free desktop (technology) to everyone. We say "technology" these
days because of mobile, cellphones, and so on, but mobile is not really what we'll talk about this week. For instance, the GNOME Shell team isn't targeting
mobile handsets as a platform.
So, in that light: GNOME 3. What's in it?
- GNOME Shell (less interrupty UI with clearer control of desktops, notifications, and launching apps), help (topic-based), possibly performance
improvements on login time (gconf-to-dconf switch, if it makes it into the release), Evolution autoconfig (probably),
- GNOME Shell is NOT slower than old UI. It might be faster, which would be nice! And Vincent Untz (of the Release Team) says that about 98% of existing
users shouldn't have hardware blockers to switching. As Jason Clinton notes, Red Hat is working all-out on fixing the possible software (driver) blockers so we
basically assume that'll be fixed in time.
- What about GNOME Activity Journal? Shell & GAJ aren't really integrated, teams
might be working at cross purposes. GAJ team has submitted a module. We
have a meeting next weekend for the release team to decide what to do.
GNOME wants something consistent. Right now, GS & GAJ seem too
different from each other.
- Accessibility improvements. The GNOME 2 accessibility framework was GNOME-specific, but GNOME 3 a11y is cross-desktop...KDE, small devices, Qt, Nokia, etc. can and will use it. The new stack is useful for a11y, desktop testing, and other purposes. For example, Stormy told us that there's an HFOSS tool that turns audio alarms into visual alarms. This is great for the hearing-impaired -- and if you're in a meeting! Remember the curb cuts principle; accessibility improvements help everyone.
A few notes about the a11y changes: speech synthesis will probably be ok. The first iteration of the onscreen keyboard may functionally be a step back. The current one is basically unused, since it's not very good. (For an example of low distribution uptake: Ubuntu currently uses a different one they coded, which is simpler but has different bugs.) The new one may not be ready by September.
- A lot of housecleaning (paying off technical debt) to make it far easier to develop and maintain GNOME apps and core going forward
- Tomboy online. By the way, Tomboy is big on other OSes! Andreas Nilsson shared his experience: he went to a neighbor's house and installed a couple of GNOME apps on their Windows machine, including Tomboy. The next week, they'd switched entirely to GNOME on Linux!
- Streamlined appearance: less chrome on some apps, symbolic icons in tray....clean & lean experience/appearance
(One issue to address is GNOME panel applets. Everyone Vincent has talked with uses about three applets (out of about 20 available ones), but
everyone uses a different set of three. So we need to work with the community to find a way to bridge that experience gap for GNOME 3.0.)
So here are some notes towards our marketing message for GNOME 3:
- GNOME 3 is about UI. Performance work, GNOME Shell, help, the streamlined appearance, and GAJ all make the user experience better and more responsive.
- Accessibility. We are the best free desktop in terms of accessibility,
- We want to talk more about the ecosystem and applications, especially since we don't generally spotlight that enough. People don't realize that GNOME is a
suite of apps as well as the core desktop. Paul blogged to ask for names of applications that are adding
new features for GNOME 3.0. What apps and desktop components/tools are adding benefits? True, the platform/components story targets developers rather than
users, and we're primarily concentrating on the user message in this hackfest and in the GNOME 3.0 marketing overall, but we do want to invest some in marketing
to developers, because they'll evangelize.
- GNOME 3.0 is iterative. We continue to evolve every 6 months. This is the beginning of GNOME 3; we're starting a new cycle. For example, GNOME 3.0 lays
a foundation to do better geolocation, desktop testing, and integration with social networking sites. We should specify this in our message to developers: "We
added foo so we can add bar next year" -- and to users: "We added foo so you can do bar." The post-September roadmap will be clearer after GUADEC, but even now
we can start on "Come to GNOME 3 and this is what we'll take you to..."
(As we talked about highlighting GNOME apps, we reminded ourselves of long-term marketing ideas, less for GNOME 3.0 than for future marketing work: a
cross-platform App Store that senses your OS and shows you free GNOME apps to download. Another: tie together About boxes on apps to Friends of GNOME. Make it
easier for users to realize that they can give back via cash donations. Store what app inspired them to give cash, and feed that app's About box with specific
users' names, once donations pass a certain amount.)
In a sense, our list of audiences (in order of priority) is:
- current users of GNOME 2.x
- GNOME developers
- the accessibility community
- distributions (such as OpenSUSE, Fedora, Ubuntu, and Mandriva)
And a home for our GNOME 3 marketing message: gnome3.org. This will be a small, product-specific site that goes away (that is, redirects/moves to
gnome.org) six months after the GNOME 3 launch (approximately). We're building the sitemap for it this week.
By the way, Paul and Vincent are going to coordinate on the improvement of the gnome.org website; evidently there's a relaunch in the works! Plone is
Stormy then led us through deciding what we'll do this week in the hackfest. HIGHEST priority:
- GNOME 3 website sitemap
- GNOME 3 roadmap/launchplan calendar
- Talking points: GNOME 3 message, making apps/components story, localizing tagline
- Pilot demo video (per Jason's script) and a template for future videos
- Developing GNOME Ambassadors materials and putting together a coherent suite of those resources
- Distro messaging
- Thoughtleadership around a11y & usability, and outreach to find/make/convert those thought leaders and GNOME 3 evangelists
And we roughly scheduled it as follows:
- Tuesday morning: talking points and launch roadmap
- Tuesday afternoon: further work on launch roadmap, and then ambassadors, website, & video template discussion starts
- Wednesday morning: lots of work on website & ambassadors, maybe video work
- Wed. afternoon: can continue videos & thought leadership
- Thursday: buffer to cover what we didn't work on earlier in the week; film video
So Tuesday morning we worked on those talking points (soon to come to the wiki) and the launch roadmap (ditto).
After lunch, we finished our rough roadmap, then spoke about some various other topics before diving into website and Ambassador work. Bharat Kapoor
suggested that we think about SMS fundraising at conferences, and about corporate sponsorship/involvement with Ambassadors.
As a group, we roughed out some ideas for what GNOME Ambassadors is (materials/collateral that anyone can use to evangelize GNOME) and for the website. One
question re: the website: will it be a Plone site? There are some dependencies here regarding the existing website infrastructure and a delayed reboot; Ryan
and I will talk about getting a project manager to do the CMS relaunch. In any case, we're going to go forward assuming that it's a Plone site that we can
localize, and that the marketing team will own the responsibility for coding it and getting it up.
Then we broke into smaller groups to get more specific on the website and Ambassadors (to get wikified when we have time -- this week, I hope!) and developed some TODOs for the work session on Wednesday.
We also met local representatives who told us about the free software scene in Zaragoza and in Spain overall. We're so grateful to them for their hospitality and support!
(And throughout the day, we captured some other TODOs that we'll do after the hackfest...)
# 04 May 2010, 01:18AM GMT+1: Now I know in part; then I shall know fully, even as I am fully GNOME:
I am in Zaragoza, Spain for the GNOME marketing hackfest. One thing that came up over dinner: People who have heard about GNOME 3 may have heard about GNOME Shell (a new UI that makes work less interrupt-y) and topic-based help. They might not have heard that the switch from gconf to dconf will significantly reduce applications' and the desktop's response time and OS login time.
Tomorrow the hackfest starts in earnest. Weird hotel mattress sleep, here I come! (It's 2:19am, regardless of NewsBruiser's attempts to make me look like I'm going to bed at a reasonable hour.)
# (5) 27 Apr 2010, 10:55AM: Importing iCal .ics Files to N900 Calendar (Maemo 5):
I have a laptop running Mac OS 10.4.11 and iCal 2.0.5 (ancient and proprietary, I know, that's why I just got the ZaReason Hoverboard running Ubuntu). I decided to move my calendaring over to my Nokia N900. iCal, select calendar in sidebar, File, Export, name it filename.ics, use Petrovich to send the file to the N900 over Bluetooth [Yay Petrovich! So great not to have to break out the USB cable], open the file upon receipt, Maemo Calendar automatically opens and imports, right?
Wrong. Only a few of my calendar items imported. I tried exporting a much smaller calendar in case it was choking on the number of items: nope. I tried diffing the file on my Mac and the file on the N900 in case it had gotten corrupted in transit: nope. And a hasty visual inspection didn't tell me the pattern of what had imported and what hadn't.
Evidently there are different versions of the .ics standard! vCalendar, iCalendar. Since I just wanted to move the content once and didn't need to set up a permanent sync solution, I started looking around for a simple clean-up importer. But then I ran into GPE Calendar, an alternative calendaring app that does properly handle iCal .ics files, before getting around to installing or running a standalone converter script. So I ended up doing this (thanks, talk.maemo.org):
I know, installing another calendar app just for the sake of its import and export seem like overkill. I am uncomfortably reminded of "Excel as a database". But it worked.
- Install GPE Calendar ("GPE PIM Suite calendar application") from the App Manager on the N900
- Within GPE Calendar, hit Import from the main menu and import the .ics file
- Verify that GPE Calendar handles the import perfectly (behind the scenes, it moves the .ics data into the GPE database)
- Open a Terminal and type
gpe-calendar -e export-from-gpe.ics
- Move export-from-gpe.ics to MyDocs/tmp/
- Open File Manager and open tmp/filename.ics to get Maemo Calendar to import the file
- Verify that all events have imported by checking visually against iCal
- Uninstall GPE Calendar via the App Manager and bask in the pretty UI and integrated alarms of Maemo Calendar
# 23 Apr 2010, 07:16AM: Out the Door:
Off to QuahogCon in Providence, Rhode Island. Say hi if you're there! I have some free time this afternoon and welcome sightseeing advice.
# (3) 18 Apr 2010, 11:16PM: A Few Tech-ish-Related Observations:
New Work City is a Manhattan coworking space/group that charges $25 for a desk for a day.
Floatleft: an international two-woman Drupal consulting firm that provides web development services to NGOs and nonprofits. Neat!
A similarly focused webdev firm is looking to hire.
KML or Keyhole Markup Language: an XML variant you use to mark up Google Earth or Google Maps.
Hierarchical Data Format: a file format that acts like a filesystem, for use with large & complicated datasets.
Unfortunately, when you do a Google search for [gnome source control] or [version control gnome], instead of git.gnome.org, the first hit is the obsolete Subversion site (although it prominently calls itself OBSOLETE and directs you to git).
# (1) 07 Apr 2010, 02:49PM: Yahoo! Labs Research Presentations, February 2010:
Two months ago, Maritza Johnson organized a trip to the NYC Yahoo! research labs for Columbia's Women in Computer Science. As a Columbia alumna, I snuck in. (Something like fifteen or twenty high-powered CS undergrads and grad students attended. Always great to be in a lobby full of smart geeky women.) I heard about some pretty keen things there, so here's my writeup.
Ken Schmidt, director of academic relations, told us about some of Yahoo!'s academic relations work. For example, academics can get a bunch of useful datasets for research via the Webscope program. Yahoo! hosts university hackdays alongside its other worldwide hackdays. The Faculty Research Engagement program provides funding, datasets, and visits. The Key Scientific Challenges program gives grad students money, secret datasets, and collaboration. And Schmidt noted that there's an active Yahoo! Women in Tech network, and that they'll be at Grace Hopper this year.
At Yahoo! Labs, you choose your office location based on what's convenient to you, and then collaborate with other people in your discipline across offices. I didn't get a chance to see their videoconference meeting rooms but I get the sense they're great.
Following are some idiosyncratic notes on the presentations we got from Yahoo! Labs researchers. We also got to talk informally with Duncan Watts, who thinks a lot about experiments, social dynamics and behavior, and Sergei Vassilvitskii, who is taciturn.
Dan Reeves has spent four years at Yahoo! Labs and works on a mix of things. He talked about Predictalot, the Yahoo! prediction game for March Madness (the US college men's basketball tournament). Reeves, who doesn't know much about the NCAA, showed us some sample bets and kept getting dismayed that they were coming up at 100% or 0% potential, until actual basketball fans pointed out that his randomly chosen bet put up a rinky-dink conference against a heavy hitter. Domain knowledge is useful sometimes.
A few lessons: running quintillions of simulations (in the web browser, when the user selects a bet to make, I think) is hard, and thus programmers took "ridiculous shortcuts." The programmers made it possible to make "weird bets" (like, math involving the sum of the seeds that would make it to the Final Four), and not too many people have taken advantage of that, which is a little disappointing. And though the prediction market is very flexible, it doesn't give you more accuracy than you get already from crude, already-known variables.
But we already have an efficient and computation-assisted prediction market, and it's called gambling. Millions of dollars change hands every year as people bet on college basketball, and metrics for success and failure are clear, so I don't find it surprising that we're already very good at predicting outcomes from known variables. Perhaps a prediction market would lead to a greater increase in accuracy in a lesser-known sport.
That same slight disappointment came up in Sharad Goel's results. Goel thinks about homophily vs. influence, which seems intriguing to me, as does his "Anatomy of the Long Tail: Ordinary People with Extraordinary Tastes". To our group he spoke about what search can predict. That blog entry has all the details. Some key points:
You can use data from people's search queries to "predict the present." For example, people are all gaga about Google Flu Trends partly because it works around lags. GFT gives you results with a tiny lag, maybe a day; the CDC can't tell you results till it's been a week or two.
But can you use search to predict the future? And how well would that compare to alternative prediction methods? Well, you can check queries in the weeks leading up to a movie release and that'll give you pretty accurate predictions for its box office numbers, but "more mundane indicators, such as production budgets and reviewer ratings, perform equally well at forecasting sales." Specifically, there's already a Hollywood Stock Exchange. Again, where there's already a well-honed prediction market, you're not going to be able to swoop in and compete all Moneyball-style right off the bat...
Sihem Amer-Yahia researches social data management. She spoke with us about relevance algorithms for social surveys. You can construct implicit networks based on shared data preferences -- for example, rankings on delicious -- or shared behavior. (Yeah, remember, Yahoo! owns The Web Site Formerly Known As del.icio.us. Over and over in these talks I was reminded that Yahoo! is making a lot of hay from their datasets: Flickr, delicious, Yahoo! Games, Yahoo! Sports (including fantasy sports), Yahoo! Mail....)
How alike are two people, based on what they tag or rank? Well, it's hard to systematically check this sort of thing via tags, because tags are sparse (whooo, folksonomy). Researchers looked at tags on Yahoo! Travel, like "family" or "LGBT." They parsed the tags and their usage to create "concepts" and to build "communities" around those concepts.
As I've known since Leonard created the Indie Rock Peter Principle, recommendation systems suffer from an overspecialization problem. As Amer-Yahia puts it, how can you incorporate diversity into the system's recommendations without hurting their relevance? Well, they have a lot of heuristics. One: use a greedy algorithm to pick the first K most-relevant results. Find which of those K results has the most similarity to that set. Then compare that most-similar result to the K+1th result. If the K+1th result is less similar, then swap it in. Continue to trade off diversity against relevance till you reach the lower acceptable bound of the relevance range (a range whose threshold you may have to discover empirically). It's a species of affirmative action.
Once you personalize recommendations (especially based on social networks), the indices you create and have to deal with get huge. I have a note here about "Storing like things together" and "Returning a composite of relevant items, validating with user's network" -- I assume those are partial solutions to the performance problems.
Another fun thing Amer-Yahia worked on: take Flickr photos and turn them into itineraries (longer paper at author Munmun De Choudhury's site). (Factoid: about 10% of Flickr photos come with automatic geotag stamping, and about 40% have semantic user-added tags that you can use to get some geographic data.) As the abstract says, "Our extensive user study on a 'crowd-sourcing' marketplace (Amazon Mechanical Turk), indicates that high quality itineraries can be automatically constructed from Flickr data, when compared against popular professionally generated bus tours." Oh yeah, the researchers love Mechanical Turk!
Amer-Yahia also spoke on homogeneity in structured datasets with strict ranking. Her demo used Yahoo! Personals as an example, which led to many subsidiary guffaws.
Basically, it's the diversity vs. relevance problem again. If you say you want to see college-educated white women aged 25-34 within 5 miles of New York City, you'll get a big dataset ordered by some characteristic. You can either rank by distance, or by age, or by level of education, but in any case you have like 100 nearly-identical results on the first several pages before you get to the first difference. It's hard to explore.
So instead we have subspace clustering, which sounds AWESOME. You cluster combinations of attributes in a rank-aware way, label them, and make sure that your resulting clusters of results have adequate quality, relevance, etc. Amer-Yahia explains this as dimension reduction to help users explore [results] more effectively.
John Langford works on machine learning. He pointed out a bunch of spots where Yahoo! sites use, or could benefit from, machine learning. He works on a "fast, scalable, useful learning algorithm" named Vorpal Wabbit. Langford demonstrated it and indeed it seemed plenty fast, although I haven't any baseline for comparison. Key phrases I noted include "linear predictor," "infrastructure helps it go & learn fast," and "plug in different, lossy-or-not algorithms?" and I assume interested folks can go check out the tutorial. A niche tool, but sounds invaluable if you're in his target market.
Jake Hofman showed us some more machine learning goodness. His tool (an implementation of vbmod, I think) scrapes the To: & CC: lines from your email to see who gets emailed together, and from that constructs a pretty graph showing the nodes & clusters in your social network. He tried it on a colleague's real mail, and indeed five distinct clusters sprang up. "That's my soccer buddies...that one's my in-laws...that's my college pals..." You can use this to have the Compose Mail interface auto-suggest recipients you might have left out.
I talked with Hofman a little after the presentations, whereupon he revealed that he hearts Beautiful Soup and Mechanize for screen-scraping login-protected or otherwise complicated websites. Evidently he got into Bayesian fun as a cell biologist getting software to automate the tedious task of classifying images from microscopes, slides, etc. Oh, there it is on his resume: "Applied machine learning and statistical inference techniques for high-throughput quantitative analysis of network and image data" and "Developed software platform to automate characterization of cell spreading and migration". Cool!
Siddharth Suri researches social networks and experiments and data mining. He presented his "Behavioral Study of Public Goods Games over Networks." He did an experiment on Mechanical Turk. Econ professors would challenge him on how representative of the population that sample is, to which he would rightly reply that they tend to experiment on university undergraduates, who aren't exactly hella representative either. Boo-yah!
Suri asks how we might get people to change or sustain socially beneficial behavior in a tragedy-of-the-commons situation. For example, how do we encourage energy conservation, discourage littering, and encourage donations to charity? I appreciate that it's a tough and important problem. However, he also said that the same question applies to online communities: how do we get people to upload photos to Flickr or write Facebook updates so everyone can enjoy them? He then investigated via a social dilemma game/experiment via Mechanical Turk, where strangers had the option to give or keep amounts of money, sometimes a "subject" was a plant who moved norms towards selfishness or altruism, etc., etc.
I find this question and approach a little bewildering. People write and share and upload online for many of the same reasons we knit scarves as gifts, host and go to birthday parties, and gossip and volunteer in the physical world. These are interpersonal, social actions that we do to bond or amuse ourselves or gain status within specific communities that have meaning to us. Experimenting on this phenomenon with strangers exchanging money on Mechanical Turk -- because that's where you can get experimental results -- seems weak.
Since this experiment was an initial pilot project, we suggested that future iterations allow the subjects to make friends with each other, or get pre-existing groups of subjects to join (e.g., have an experimental group composed of coworkers). Another attendee worried aloud that these measures might allow a "false sense of community" to arise and throw off the results. But who are we to call any sense of community false? And community is the answer to the social dilemma, anyway, isn't it?
Overall, a thought-provoking and enlightening way to spend a few hours. Thanks to Johnson and Schmidt for setting it up. I also thank Yahoo! Labs for the lunch, USB drives, pen gadgets, and fleece scarves. Let me know if I'm wrong about anything!
# 31 Mar 2010, 01:41AM: GNOME Video Site, Mysterious Bugzilla Upgrade Patron, Mallard, Acire/Quickly, An Interview & A Goodbye:
I'm an editor and the release coordinator for GNOME Journal, which just released its 19th issue.
This issue has six articles:
- Will Kahn-Greene introduces the GNOME Miro community, a website that brings GNOME-related videos to users.
In November 2009, I released GNOME Miro Community. I'd just had a hard time finding GUADEC 2009 session videos, and Participatory Culture Foundation had just released the Miro Community curated video collection and search platform. So I decided to create a Miro Community focusing on GNOME-related video, so the next person will have an easier time finding things....
- My article describes why and how Canonical paid tens of thousands of USD to upgrade the GNOME bugtracker.
GNOME bug-wranglers can now enjoy Bugzilla's per-product permissions, duplicate prevention, localization, and myriad enhancements from the last few years. And Bugzilla users will get to enjoy several features that started with GNOME's modifications. The browse.cgi view gives you a dashboard view of a project's outstanding bugs and patches. Users can indicate the status of an attachment to a bug (e.g., "accepted-commit_now" or "needs-work"). Everything Solved also developed a stack-trace parsing extension, traceparser, for Bugzilla 3.6. All in all, Everything Solved upstreamed more than forty features or bugfixes.
- Stormy Peters interviews an Igalia cofounder and member of the GNOME Advisory Board.
Sometimes we the small open source consultancy companies can be seen as working right in the middle of two very different worlds: the evil empire of companies wanting to make profit, and the pure and ethically oriented free software community. But at the end there are a lot of shared interests and huge potential for the win-win. The main challenge is to find the people in key roles of big corporations or institutions that really understand how free software works, the dynamics of the community, and the right way to approach a project and have influence (as opposed to control) in its future.
- Jono Bacon describes Acire, Quickly, Ground Control, and the whole toolset for whipping up quick one-off Linux desktop apps.
While most GNOME developers know that Quickly makes it easy to generate GNOME projects and package them for Ubuntu, Quickly actually has a template-based system, which means you can write any kind of application in it (this could include KDE applications and packaging for other distributions). What I like about Quickly is that it automates much of the repetition surrounding software development and it ultimately allows you to deploy software to your users. This instantly allows opportunistic developers to feel a sense of success around their projects as they can develop with ease--and deploy to real users with ease too.
- Shaun McCance explains Mallard, a new XML syntax for writing user documentation and help.
A Mallard document is a collection of pages. Each page stands on its own. This is different from traditional documentation formats, where a document is a linear sequence of chapters and sections. The idea is not new. Encyclopedias have been organized around self-contained topics for centuries. When the idea is applied to documentation, it's called topic-oriented help. Users can read what they need without reading an entire manual.
- Jim Hodapp writes his last Letter from the Editor.
Well, it is a sad day for me to say that I am leaving the leadership role of Editor-in-Chief; my ability to devote the time and energy to bringing the best content to the GNOME Journal is currently not possible. But it is a happy day that I’m passing on that role to Paul Cutler.
Paul, Jim, the authors and I put some hours into this and I think it's worth it. Check it out.
# 28 Mar 2010, 11:41AM: Angie Martin:
Last week, bloggers commemmorated the annual Ada Lovelace Day. It's a day to honor influential and inspirational women in technology and science. To quote one participant,
We are not Unicorns. We are everywhere. But our history is easily submerged, discounted and dismissed. Too easily forgotten.
Following the Women in Free Software blog aggregator today showcases how many women, living and dead, deserve this honor. Please excuse my belated post; this was hard to write.
Last year I listed some of my influences; now I'm realizing that every year I'll have the chance to celebrate at least one person in depth, so I'm going to speak about someone I deeply wish I'd gotten to know better.
mySociety core developer Angie Martin changed her name from Angie Ahl a few months into 2009, when she got married, and a few months before she died.
I'd met her on the Systers email list in October 2007, when she'd mentioned that she was up for a job with a UK org that created systems that helped facilitate government-public interaction and democracy in general. She doubted any Systers outside the UK would have heard of them, so of course I emailed her asking, TheyWorkForYou/mySociety? She got the job, and was "so chuffed": "I've been grinning for about 48 hours now," she told me, her morale sky-high that she'd impressed these people she respected so much. And she'd beat out an all-male field for the job:
Who says girls can't compete.
This was after she'd worked several years as one of a two-person web design firm, which was after hostmaster work at an ISP.
I mentioned that I knew Danny O'Brien, who was also in the UK digital-rights/participatory-democracy-tech scene. "...small world - I know him from years of reading need to know. I was jokingly going to wear my old battered NTK T-shirt to the interview... I should have done ;)", she replied. We talked a bit back and forth over the next few years. I'd hoped to meet her on a trip to London, but she lived in Cumbria (in the Lakes Districts), so we never met up.
She migrated the mySociety website to WordPress even while ill. She went on an org retreat, and got an Ada Lovelace Day shout-out from her colleagues.
Angie is mySociety through and through. A born perl hacker, never happier than knee deep in some grungy regular expressions, she's also gifted with an inate understanding of the possibilities of technology for democratic reform. At interview I asked her what change she'd like to see happen from the government side of our sector, and she replied that she thought the biggest possible win was to publish Bills in parliament in a proper format. You might have heard all this before, thanks to Free Our Bills, but Angie was commenting several months before we ever discussed the idea for the campaign with anyone else. She'd just looked at the world and the obvious problem had jumped out, clear as day.
She was eager to see Open Rights Group grow, and to see fair usage rights in the UK established properly. She loved the idea of Quinn's Symphonic Conundrum and wished it could be done. She loved Perl and jested that a bone scan that briefly turned her radioactive might give her superpowers.
In February 2009, Ahl learned that her cancer was terminal. She got married about a month later -- about a year ago. (Her widower, Tommy, is a photographer, and he loved to photograph her.)
Martin died of cancer in July 2009, having only begun the mySociety work she'd passionately wanted to do. Her partner, her colleagues, and friends and peers grieved their loss:
Angie was one of the true pioneers of the Lasso community.
Her contribution to the Lasso community was absolutely immense.
Angie and I often talked offlist about ways to move our programming
ahead - about how to bring levels of functionality into reality that
no one else was doing yet. Her level of understanding of the most
abstract concepts, and how turn them into code was absolutely
She pioneered the error.lasso method, which so many people use today.
She was also the first to figure out how to build search engine
friendly URL's with Lasso. She contributed a ton of innovations, too
many to list. Her contribution to the Lasso community is immeasurable.....
The fact that Angie was talented enough that she could have walked into a very high paying job with virtually any company in the world she wanted to work for (and could have named her own price salary wise), but chose to use her skills and her time to help a not for profit organisation like mySociety, speaks volumes about the immense depth of her character....
Given her habit of plain speaking, it is pointless to pretend that Angie was able to make the contribution to mySociety’s users or codebase that she wanted to. What she achieved in terms of difficult coding during recovery from chemotherapy was incredible, breathtaking – but she wanted to change the world. It now falls to the rest of us, and our supporters, to live up to the expectations she embodied...
What's that saying about the last full measure of devotion?
I hope this remembrance helps us appreciate all the tough, brilliant, geeky, dedicated women in our community, and work in memory of the ones who have left us, like Martin.
# (2) 14 Mar 2010, 10:18PM: Web:
About eleven years ago, I saw a link from Slashdot to a geek humor site called Segfault. I started reading it, then started reading the homepage of one of the editors. Leonard Richardson. He posted something new nearly every day, like a diary. (I didn't know the word "blog" in 1999.) He shared funny lines from his friends, his mom, his colleagues. I kept reading.
About ten years ago, I started reading Joel on Software. Just a few years previous I'd discovered Gerald Weinberg, specifically his The Psychology of Computer Programming, and loved it. So this Joel guy was talking about things I found interesting, and was introducing lenses, metaphors, models that immediately spoke to me. Fire And Motion. Ben & Jerry's vs. Amazon. The Law of Leaky Abstractions. Managers as the developer's abstraction layer (I later heard the synonym "windshield"). Smart and Gets Things Done. The iceberg problem in software development. Five Worlds. Architecture astronauts. I could go on.
Almost exactly nine years ago, I saw a funny line ("Those guys are gods of applied physics!") in an article on SFGate, decided that Leonard guy would appreciate it, and sent it to him. He and I started corresponding, and then hanging out. I went down to Bakersfield with him one weekend to help his mom move. Eventually we started dating.
About four years ago, I saw another pivotal blog post. I was living in San Francisco, in my third year working for Salon, and realizing that I'd like to go into management, and this Joel guy announced that his company was looking for me. Well, for someone who wanted to lead geeks, not necessarily a programmer. I saw that post, then woke up at 3am the next day, thinking, "I have to apply."
I applied, thinking I hadn't a chance in hell. Joel phone-screened me. I'd been told to prepare a short lesson ahead of time, on a topic of my choosing. So I came up with my stand-up comedy lesson plan, which I still use today. He asked whether, if accepted, I could move out to New York the next month. I hesitated a second or two, then said sure. They flew me out for an interview. I got an offer and said yes. Fog Creek paid handsomely to relocate my household. Leonard, who had left Collabnet to work on Ruby Cookbook, came with me. He'd never seen New York before we arrived in January of 2006.
Leonard and I were unhappy that we were moving so far from his mom. Frances had been fighting HIV for more than a decade, and had lived far longer than the doctors had ever predicted, but her health was still perceptibly declining. So I told him he should fly back once a month to see her. But he didn't get much of a chance to do that, because her health started getting much, much worse a few months after we moved. Leonard flew back and spent several weeks with her as she died. I took some time off to go be with her; later I discovered that Fog Creek had quietly, kindly given me those days for free, and not counted them against my paid time off.
Of all the job perks I ever got at Fog Creek -- relocation, half a Columbia Master's paid for, lunches, Broadway tickets, unlimited sickleave, Metrocard, a great library -- that one sticks with me most.
Oh man, this thing is getting long. Anyway. I learned a lot from Joel, before, during, and after my time at Fog Creek. I appreciate his decisiveness, his straightforwardness, his species of eloquence and encouragement, his financial generosity, his entrepreneurial spirit, and his insight. Sure, it wasn't all roses and sunshine, but he changed my life, mostly for the better.
A few days from now, Joel Spolsky will retire from active blogging, ten years after he started. Leonard and I are married, and still live in New York, and will for the next year at least. We still miss Frances terribly. Segfault's been gone for nine years. My Fog Creek salary subsidized Leonard's work on Ruby Cookbook, then RESTful Web Services. I have a master's degree in tech management and am looking for my next job in that field. Fog Creek was 6 or 7 people when I arrived, and now it's thirty or more. All those articles of Joel's are up on the web, ready for us to reread or brandish or rip to ribbons.
And so are my archives, and Leonard's, and Frances's.
It really is a web, isn't it.
# 14 Mar 2010, 03:20PM: QuahogCon and Open Source Bridge:
In the US style, the date is now 3/14, which makes it Pi Day. Happy Pi Day! (I'll have to remember to celebrate Mole Day on 23 October; I always forget, despite Mr. Marson's success in making me love chemistry.)
More calendrical news: I'm going to QuahogCon in Providence, Rhode Island, April 23rd-25th. They have infosecurity and DIY/maker tracks. I'm especially interested in a few talks:
but of course there's way more advanced stuff about SQL injection and WiFi vulnerabilities and bone-chilling madness, &c., &c. Let me know if you're going; I'm interested in splitting a hotel room with another woman. WILL YOU BE HER?
I've also nearly decided to go to Open Source Bridge in Portland, Oregon, at the beginning of June (right after WisCon, which may be a bad idea). I've submitted a proposal for one talk ("The Second Step: HOWTO encourage open source work at for-profits"), and plan on submitting one or two more.
# (2) 05 Feb 2010, 11:48PM: Another Change:
I'm no longer working with Collabora Ltd.
In the first several months after I joined Collabora in April 2009, I served as lead project manager, got the new website up, and started putting some new project management processes into place, especially in research and development. Then I shifted to personnel management, and created and began implementing a performance assessment system. All the while I gardened the wiki, aggregated and edited weekly internal reports to keep the company on the same page, blogged about our work, and generally gave people the information and the nagging they needed to make informed decisions. (In retrospect, I played facilitator, historian, and journalist a lot, plus mentor to 50+ Collaborans.)
Collabora's a different place than it was ten months ago; I helped move them from a startup to an enterprise footing. Management structures change as needs and capabilities become apparent, so the directors and new hires (including the awesome Martin Barrett) will carry this work forward, and I offer them my best wishes. I'm happy to talk more in detail about what I did at Collabora, especially if you're interested in what I can do for your organization.
In the near future, I'm taking some time to relax and take care of existing obligations before I incur new ones. Then, starting in late February or early March, I'll be volunteering fulltime on some open source/free culture projects for several months. I haven't yet decided which ones, or in what capacity, so feel free to recruit me.
# 03 Feb 2010, 04:18PM: Change of Plans:
Image nicked from Leo Antunes. (I thought about creating some sort of Belgian-waffle-with-a-NO-sign-on-it but this services.)
I'm not going to FOSDEM this year; change of plans. Perhaps next year.
# 26 Jan 2010, 06:11PM: Tacky, Metacity, Encryption, tp-qt4, and Maemo:
A few things Collabora folks have been working on recently (along with the constant stream of Telepathy-related releases):
Daf Harries released tacky, a simple python-based paste web app. Basically it's like a simpler version of pastebin, and you can install it on a private server in case you're talking about something confidential in private chat/IRC.
Thomas Thurman is looking for new contributors to mentor to help with Metacity (a window manager).
Cosimo Cecchi posted his TODO list for "a Telepathy implementation of the XTLS protocol, an end-to end-solution to crypt communication over XMPP". Cosimo and Eitan Isaacson are both working on encryption; Eitan has been plugging away at interactive certificate verification.
Andre Moreira Magalhaes is blogging to raise awareness of Telepathy-Qt4, a convenience library for people who want to use the Telepathy framework in their Qt applications.
And we've all been playing around with our N900 devices (Collabora company gifts). Tollef Fog Heen provides scripts & procedure to move SMSes and contacts from iPhone to N900, Felipe Zimmerle wrote an inclinometer, Jonny Lamb released a file transfer app and extra goodies to help you chat with people on lots of networks, and Thomas asks for testers for his new version of robotfindskitten.
Because we're hacking around, some of our apps you won't find in the default software repositories in the N900's applications manager. Here's a short guide:
Maemo Extras contains quality-controlled applications written by the community. It's installed on the device, but disabled by default.
To enable: Within App Manager, select "Catalogues" from the menu, find "maemo.org", and untick Disabled.
Maemo Extras Testing contains the applications developers are preparing to update. There are lots of applications here and all need help in testing and validating. People can vote good applications up by visiting the application list; once enough people do that, an app moves to the regular Extras repo.
Still, these are not quite ready for prime time, so be cautious! One colleague offers this tip: "if you want to just find good quality applications within Extras-Testing, review this packaging list and find those with the most QA votes."
To enable: Within App Manager, select "Catalogues" from the menu. Click "New" and add the following details:
- Catalogue Name: Maemo Extras testing
- Web Address: http://repository.maemo.org/extras-testing
- Distribution: fremantle
- Components: free non-free
("Fremantle" means Maemo 5, the version of the Maemo operating system that the N900 runs. "free non-free" tells the manager that you want both open source and closed source applications; change this if you want.)
Maemo Extras-Devel: contains untested and wildly variant applications that might harm your system. Use this repository sparingly since the applications are unstable.
To enable: follow directions on the maemo.org wiki.
# (2) 24 Jan 2010, 11:06AM: Upcoming FOSDEM & UK Travel:
I'm going to FOSDEM, the Free and Open Source Software Developers' European Meeting, the first weekend in February. (Something like twenty of my Collabora colleagues will be there, including some I've never met before.) I've been to England & to Russia, but you can waffle around as to whether those are really Europe. But FOSDEM is in Brussels, Belgium! Very European, and makes its own waffles. I'll be arriving in Brussels a day or two before the conference proper. After it ends, I'll ride the Eurostar train (!) to England and see my Cambridge colleagues for about a week.
This is a management discussion trip and a seeing-people trip; as helpful as occasional facetime is for developers, it's essential for a manager like me. So, if you live in a bit of Europe or England such that it's easy for you to visit Brussels or Cambridge, I'd love to see you. And if you're giving a FOSDEM talk I absolutely must see, let me know! I'm interested in checking out:
- the Mozilla folks - I've mentioned the work Collabora's doing on Firefox for Mobile, and I'd like to learn more about WoMoz
- the Jabber/XMPP developers' room, including talks like "The Extraordinary, Magical Powers and Possibilities of XMPP", "PubSub Gone Wild", and of course "Multi-User Jingle: Voice and Video Conferencing with XMPP" by my colleagues Dafydd Harries & Sjoerd Simons
- Introduction to the GNOME Bugsquad
- My colleague Daniel Stone's "Polishing X11 and making it shiny"
- A variety of talks on optimizing performance -- MySQL (my previous notes on the subject), sysadmin tools Flapjack & cucumber-nagios, identi.ca, and Cassandra, Hive, Haystack, memcached, Scribe, and Thrift. I like learning about systematic performance monitoring and optimization.
- "Promoting Open Source Methods at a Large Company"
- Smuxi, "an advanced IRC client that solves the 'always available' problem in a graphical environment"
- "Hidden Pearls": "uniquely useful" code OpenOffice has that other projects should consider reusing
- "Tor: Building, Growing, and Extending Online Anonymity"
- Defending the development of no-future alternative OSes using insights drawn from queer theory
- Lightning talks on GNU Savannah (sort of a Launchpad competitor?), OpenERP, and the Kaizendo customizable schoolbooks project. I'm also oddly compelled by the mysterious "Open-source software: Blaming the unknown, or a constructive approach to technology".
- The Linux distributions developer room: "How to be a good upstream", "Mobile distributions and upstream challenges", a study of how Nokia and community folk govern the Maemo project together, and most excitingly, personnel management within Linux distributions
(I'll have to put together a list of all the Collabora talks soon.)
Family continuity note: Seven years ago, Leonard went to Belgium for the European Python conference. I helped him brush up on his French, he hung out with Jarno Virtanen & Taina Prusti, etc., etc., etc.
# 14 Jan 2010, 03:49PM: Some Recent Collabora Open Source Development:
Has it been three months since I provided a snapshot of Collaborans' open source work? Too long! Here's a taste of our work from the end of 2009 & the start of this year (and there's a lot I'm leaving out, like a bunch of Maemo work, because otherwise this entry would go on forever! I'm already several days out-of-date):
The photos here are all from the Gran Canaria Desktop Summit last year, which was warm and fun. January (here in the Northern Hemisphere) is a good time to remember how nice that was.
# (6) 19 Dec 2009, 07:54PM: Everything I Knew (About Battery Care) Was Wrong:
Today I learned that I've been working from an obsolete understanding of how to keep my cellphone and laptop batteries from losing gobs of capacity over time. A simplistic summary follows for your benefit.
The batteries in my phone and my work laptop are lithium-ion batteries. Check yours -- the "Li-Ion" abbreviation means it's lithium-ion. As detailed sources explain, charging/discharging battery care for lithium ion batteries is the opposite of the conventional wisdom I had in my head, left over from the old days of nickel-based rechargeable batteries.
It used to be that you'd want to run batteries all the way down before starting to charge them again, because otherwise the capacity might get messed up. That's not true with lithium-ion batteries; it's recommended that you only rarely let an Li-Ion battery run down below 10% of its charge.
Lithium-ion batteries lose capacity, in the long run, if they sit overcharging a lot, or if they run hot a lot. So don't let them sit plugged into a charger all the time, and if you usually run your laptop plugged into AC power, think about removing the battery and setting it someplace cooler.
The moment a lithium-ion battery gets manufactured, it slowly starts losing capacity. So buying a primary battery + a spare battery simultaneously might be a worse decision than using a primary battery, then getting the spare battery years later, when your capacity has substantially degraded.
This came up because I assumed I should let my new N900 run down completely (on the partial battery charge from the factory) before plugging it in, and I was annoyed that plugging in the USB-to-microUSB cable to transfer files meant it was getting juice while the battery hadn't totally discharged. But I was wrong to worry! Thanks for straightening me out, Sjoerd.
# 23 Nov 2009, 06:03PM: Can't Play Tour Guide Without A Map:
GNOME Journal just published my Telepathy overview, and my colleague Danielle Madeley's "Telepathy, Empathy and Mission Control 5 in GNOME 2.28".
I'm not a developer, but I can at least help create accessible documentation. Telepathy world domination depends on accessible documentation: like the Telepathy book, but even more so. Newbs likely have trouble finding comprehensive overviews of some aspects of Telepathy: design issues, misconceptions, and the status of various efforts. They come to #telepathy (on irc.freenode.net) and ask us questions, or just drop the idea of developing with Telepathy, or struggle in silence and make mistakes.
Danielle's book and article will help. I hope my article helps. I've made a small list of areas where I think a concise "here's the deal as of today" blog post or article or mailing list post (or wiki page clarification) would be cool. Basically, they're what I've had to learn to grok the direction & momentum of the project. I hope to create, improve or encourage friendly overviews of the following (in my Copious Spare Time):
(a) the major connection managers & their state of readiness/stability
(b) the up-&-coming CMs and their potential promise (e.g. yafono)
(c) mobile, Moblin, maemo-extras
(d) encryption/privacy/OTR/SRTP issues
(e) Muji/wocky work
(f) expanding our reach to KDE
(g) testy stuff like telepathy-ashes & echobot
(i) Python bindings
Anything to add to that list?
# (8) 10 Nov 2009, 01:26PM: Here It Comes:
The Queen has approved Leonard's dependent partner's visa, so it's now official: in about a month, we'll be moving to Cambridge, England, so I can work side-by-side with colleagues at Collabora headquarters. Many more details to follow.
# (3) 20 Oct 2009, 05:51PM: Collabora Open Source Development Overview, 4-20 October 2009:
Collabora, my company, does open source development. We don't just build on top of open source frameworks; every day, Collabora developers are hacking in the open on multiple projects.
I decided to blog about some of what we've done in the last couple of weeks.
First, our flagship project, Telepathy:
- David Laban's new echobot helps test text and audio chat in Empathy.
- Mike Ruprecht got the telepathy-haze connection manager to do audio-video calls successfully; people on more and more networks and protocols will be able to use Empathy for audio and video chat.
- Andres Salomon backported Empathy to debian-stable (lenny).
- Will Thompson, Rob McQueen, and Sjoerd Simons drafted a Telepathy spec for encrypted channels and how that works for off-the-record conversations.
- Siraj Razick, Simon McVittie, and Dariusz Mikulski worked on cleaning up some Telepathy-on-Windows code; Dariusz is making sure the contributions the RealXtend developers have made can make it upstream.
- In the oFono world, Olivier Lê Thanh Duong shepherded an oFono patch through, and Andres uploaded oFono 0.8 for Debian.
- Jonny Lamb uploaded new Debian packages of Empathy and telepathy-gabble (Telepathy's Jabber/XMPP connection manager, which can handle single- and multi-user chats and voice/video calls), in addition to lots of other Empathy work.
- Vivek Dasmohapatra worked on telepathy-gabble and wocky (XMPP library).
- And several Telepathy components saw new releases:
Collaborans also worked on Tubes, Teamgeist (part of Zeitgeist), Maemo packages, GStreamer, Farstream, and other projects. Just a few items, because it would be exhausting to cover everything:
Collabora also encourages its staffers to go to conferences to talk about open source. Last weekend, participants in the GNOME Boston Summit and the Amsterdam Maemo Summit led several discussions (Marco Barisione's Telepathy on Maemo slides are especially valuable).
And more FLOSS conferences are coming up soon: Gustavo will be at a WebKitGTK+ hackfest in Spain in December, and Helio will be at Latinoware 2009 later this week in Brazil.
Sorry to those I left out or didn't link. This list is obsolete even as I hit Post...
# (4) 08 Oct 2009, 11:44PM: An Oversimplified Cliffs Notes To Telepathy:
Lots of people have never heard of my company or its projects -- even fairly plugged-in geeks often say "who?" or say "Oh yeah, the Subversion people." (No, that's Collabnet, where Leonard used to work.) So this post is specifically for my friends, to help explain one thing my company is doing that is cool. I'm going to simplify a lot so I hope my colleagues and other hard-core geeks don't wince too much.
It is annoying to have to log in to a bunch of different chat services to reach all your friends. MSN, Google Talk, AOL Instant Messenger, Bonjour, blah blah blah. You may not think this is related, but it's also annoying that if I want to work with someone on a document and we're at different computers, I can't use my regular word processor, I have to load up a web browser with Google Docs. And it's annoying to have your cell phone text messages (SMS) in a different place from your other chats.
These are all aspects of real-time communication. As my colleague Danielle put it,
The Telepathy project is helping solve all these problems. Telepathy is a project aiming to give desktop applications (like word processors, jukeboxes, CAD programs, and games) a way to painlessly integrate instant messaging and VoIP (voice over IP) telephony features. In more technical language, in Telepathy, Collabora aims to develop a real-time communications framework for the desktop and embedded devices.
My boss, Rob McQueen, was one of the Telepathy inventors, and I work for Collabora, the company he co-founded. We hope programmers will use Telepathy to improve your computer and cell phone and get rid of the annoyances I mentioned above, and create neat applications and services. We've already gotten started.
Here's one way of viewing the Telepathy framework. It has three essential parts:
- a bunch of Connection Managers, each handling the interaction with a protocol, such as Google Talk, XMPP, various VoIP (internet phone call) services, or AOL Instant Messenger
- Mission Control, managing accounts and channels (the individual protocol-bound pipelines that your messages go through)
- a specification, telling all the parts how to interact (very technical)
This design gives Telepathy a lot of flexibility. If a new interesting service comes along, like Facebook chat, we can just write a new Connection Manager for it and bam, anything that uses Telepathy can now interact with it. And there are a lot of text, voice, and video chat networks! Who knows what other interesting collaboration or communication networks might hook into Telepathy someday?
Another important aspect of Telepathy's architecture is D-Bus. Telepathy is primarily a project for the open source Linux operating system. It's built on D-Bus, a piece of Linux infrastructure that lets applications, frameworks, and low-level system components talk to each other. So that means Telepathy can act like a wormhole, not just between two different people's computers, but between unassuming regular ol' apps on their desktops. You and a friend can collaborate on writing a paper together right in your word processor, or play a game against each other. And you can do it without having to deal with a slow, limited web app in a web browser.
In case you are a geek and find this interesting: There's an entire online book with more detail, and a system overview with a pretty graphic. And of course we're an open source project and you're welcome to join us.
In the real world, even regular folks like you and I are getting the benefit of Telepathy with (for example) the new N900 smartphone. Evidence of Telepathy's awesomeness is in the addressbook -- it combines your friends' various text chat, phonecall, and other contact info in the same screen, rather than making you use separate programs.
I use Telepathy every day, because I use the Empathy chat program to talk to my AIM and Google Talk friends all in one tidy window. Telepathy has made some other cool applications possible; I wrote about them for the new Collabora website, and if people want, I'll post a little about those.
Note to self: in future posts, explain GStreamer, Farstream, WebKit, Electrolysis, and how we make money.
# 08 Sep 2009, 11:24AM: Three Great Marketing Moves:
- Leonard and I attended a preview screening of the Coen Brothers' film The Man Who Wasn't There and got a promotional comb. We still have and use it, several moves later.
- I was chary of jumping into Battlestar Galactica without seeing the miniseries and all the episodes in order. Then one day, at the cash register at Midtown Comics, I saw a stack of free DVDs. Battlestar Galactica: The Story So Far. The iTunes store gave it away for free, too. I watched the clip montage summary and got sucked in, and from then on watched each new episode
- My colleague Thomas Thurman is blogging a tutorial on developing applications for the Nokia N900 smartphone.
# 03 Sep 2009, 05:30PM: First:
I'm in Boston for a couple of days, co-working with my colleague Andres Salomon, a.k.a. dilinger. He's been hacking on oFono on Collabora's dime, and last night's 0.4 release included work by Andres to add support for HTC G1 (the Dream) modem devices.
The oFono project is trying to be a well-designed interface to all the cell phone goodies -- texting, making cell phone calls, etc. Developers will be able to integrate their applications with the oFono architecture. With Andres's work, oFono now has its first working full-featured (voice calls + SMS) driver on a handset.
In case this interests you: Andres has uploaded a Debian package for oFono -- you should see it wend its way to the public soon. The future will also include a Telepathy Connection Manager for oFono; stay tuned.
Update: package accepted.
# (1) 29 Aug 2009, 09:22PM: Blog Move And Thunderbird Tip:
I've now moved from my old webspace at the Open Computing Facility (at the University of California at Berkeley) to space on a server that Leonard controls. So this is a test post to mark the divergence of those old archives and this now-canonical space for the blog at harihareswara.net (redirecting from brainwane.net once the DNS propagates, etc.).
Let's have some useful content to keep it interesting: let's say you're using Mozilla Thunderbird as an email client, perhaps on Ubuntu Linux, and let's say you want your email replies to include the date of the email you're replying to. I found this tip helpful:
- use the Edit: Preferences dialog box
- go to Advanced
- click the advanced configuration editor
- type 'reply' into the filter box to search for configuration entries that include the string 'reply'
- click on the reply header type line
- double click that
- change 1 to 2
- close/OK all the windows, you should be set
# (2) 20 Jul 2009, 07:45AM: Found Poetry:
Inadvertently lyrical lines overheard at the virtual water cooler:
and if that package doesn't build, I'll need to give it another poke
and when we get the screen, we test and choose
I'm back in New York City.
# (3) 17 Jul 2009, 11:34AM: More Notes From The Office:
Sure, it's usually true that a job interview is going well if the conversation goes swimmingly, with no 90-second interruptions for explanations. But not if I'm interviewing a Brit. What's a second-class degree? What's a "supervisory" in this context? And so on.
From today's IRC conversation, after I pointed people to IKEA tumbler hacking:
* sumanah kills the entire company's productivity; secretly working for [competitor]
# (1) 14 Jul 2009, 10:15AM: Obvious Tech Talk Q&A Prep:
A certain species of tech talk goes like: "Here's a product/methodology/tool I hack on, here's what it's good for and how/why you should add it to your toolkit." It's an honorable and useful presentation topic. As you prepare your talk, think about the questions your audience will have in the back of its head. If you can address them in the talk itself, great. If not, prepare answers for use in the questions-and-answers session.
- How do I get started using it?
- Why should I use this instead of the competition?
- Security implications?
- Performance implications? ("Yes, but does it scale?")
- Who's using this in real life?
- Where's the project going next? What do you need help with?
- What language is it written in?
- Why did you name it that?
The most important question is the one you hope no one asks because the answer is embarrassing. What would your smartest enemy ask?
(List developed while helping Youness practice his libnice talk last week.)
# (1) 14 Jul 2009, 07:13AM: The Home Office:
I am finishing some berry tea from a ninja-logoed mug. I am in an office a few floors above the ground, across the road from King's College. I see English summer light and the college spires through the open window. We laugh out loud when someone says something funny on IRC, and then laugh again at someone's one-upping reply. It's Tuesday, so we're going to eat pizza at the two-for-one Tuesdays pizza place. The noon chimes just rang. I have a huge TODO list. Two of those items are making proper TODO lists from meeting notes.
I am happy.
# 10 Jul 2009, 11:39PM: My Standby Joke:
A few times in the past year, I've taken the risk of leaning over to an English-speaking stranger in the airport, one who's wearing a suit or the like, and saying, "Ah, the glamor of business travel." It hasn't yet failed to get a laugh.
# 29 Jun 2009, 04:15PM: Getting (Irrelevant) Things Done:
I am bikeshedding my own yak-shaving. This should win an award.
# 29 Jun 2009, 03:04PM: Travel Schedule:
I'm going to the Gran Canaria Desktop Summit next week. Developers, managers, and other free software enthusiasts in the GNOME and KDE communities get together on the Canary Islands, which are technically part of Spain but sit off the coast of Africa. Then I spend a week in Cambridge, England, working alongside my fellow Collaborans. Yup, it's all for work, and I won't even think about bringing a suit (other than a bathing suit).
# (3) 16 Jun 2009, 02:30PM: On Dentistry:
I went to the dentist last night, specifically at the NYU College of Dentistry. I actually prefer the dental school experience to many private practice dentistries. The wait in the waiting room is shorter (2 hours per appointment actually spent in the chair, rather than an hour in intermittent waiting plus an hour in the chair), I get treated by eager-to-learn dentists in training rather than bored, laconic hygienists, and the student dentists are thorough and communicative. And they offer a 6pm-8pm slot. Very few private practices do.
Young student dentist Stringer was the one to phone me up to set up an appointment. He was more deft, gentle, and patient than several DDSes I've patronized. "Oh, you build up a lot of calculus here, because of your salivary gland. I have that too," he confided. He checked in with me about whether the ultrasonic cleaning dealie was running too hot and hurting me. "I don't like to use it, I don't think it's gentle enough," he said. He handed me the suction wand: "Raise your hand if you need me to stop so you can suction."
In further stereotype-demolishing, Stringer does not play World of Warcraft (nor does he wear Ira Glass glasses). My cousin-in-law-in-law Aaron, husband of Kristen, is on the road to full Dentistdom and enjoys WoW-style games. [pun about grinding omitted]
I told Stringer what his last name means in journalism; in retrospect, he has a new occupational surname, like Smith or Cooper.
I get curious about others' occupations. Firefighters, CAD designers, directors, transcriptionists, silversmiths, pastors, teachers, full-time caretakers, taxi drivers, deli owners, X-ray technicians, soldiers, construction workers, dentists. How does doing your job change the way you interact with others?
# 25 Apr 2009, 07:56PM: Translation Of A Truth:
I reread much of Neal Stephenson's Cryptonomicon a few weeks ago and found this passage:
"We're businessmen," Avi says. "We make money. Gold is worth money."
"Our wealth is work," the man said.
"Gold is the corpse of value," says Goto Dengo.
"I don't understand."
"If you want to understand, look out the window!" says the patriarch, and sweeps his cane around in an arc that encompasses half of Tokyo. "Fifty years ago, it was flames. Now it is lights! Do you understand? The leaders of Nippon were stupid. They took all of the gold out of Tokyo and buried it in holes in the ground in the Philippines! Because they thought that The General would march into Tokyo and steal it. But The General didn't care about the gold. He understood that the real gold is here--" he points to his head "--in the intelligence of the people, and here--" he holds out his hands "--in the work that they do. Getting rid of our gold was the best thing that ever happened to Nippon. It made us rich. Receiving that gold was the worst thing that happened to the Philippines. It made them poor."
--p. 858, paperback
More decade-old Stephenson analysis coming later tonight.
# (4) 23 Apr 2009, 06:45AM: Learning:
In the last two weeks, I have learned rather a lot about configuring and troubleshooting usage of Empathy, Telepathy, Synaptic, PPAs, git, TeX/LaTeX/dvi, gtimelog, IRC and bip, RSA SSH, and XMPP. Well, it was a lot to me.
I've also learned that if I want to get up around 6am consistently, I have to go to bed around 9 or 10pm consistently, and that if I work in a windowless rented office then I won't know till I leave that it's raining. So I'll just be making a cameo at the io9/Tor.com shindig tonight, and I'm trying to pay attention to the weather symbols in the clock gadget in my taskbar.
# 18 Apr 2009, 08:04AM: Ramping Up:
In my first week at Collabora, I've learned that I can stand to poke at .conf, .rc, and similar files for at most two hours out of my working day. I've also learned that the Ubuntu version of Firefox doesn't give me a warning if I hit Back after typing form data on a webpage; not sure how to fix that. The Lenovo x200 ThinkPad is light and small, and I'm adjusting well to the nub-mouse, but there's a dedicated Back key right where my fingers think the left arrow key is, which gives me a few "arrghs" a day. I may dedicate some fiddling time next week to disabling that key. And I renew my grief that IRC is not a common feature of every office environment.
As lead project manager I'm to keep on top of all the work we do, for clients and for the community in general. So this week I've been drawing diagrams of technology stacks and who's doing what, and memorizing thirty real name/IRC nickname pairs. If I were Juanita from Snow Crash I would be developing face-based avatars for all my new colleagues, but since I am not perhaps I should get a bunch of Dungeons & Dragons figurines and set them up on a campaign map representing VoIP, embedded Linux, mobile, etc., etc.
# 11 Apr 2009, 07:50PM: This Retrospective, In Retrospect, Has A Theme:
An abbreviated diary of the past few days, mostly for future Sumana's use:
Wednesday I went to Supper and the Sci-Fi Screening Room with a journalist who opines that it's his God-given right to drink scotch at his desk when he's on deadline.
Thursday I saw Tim Wu, Stuart, Jena, and Hailey as we hashed out next steps and plans for AltLaw. I stopped by Midtown Comics after; Hal had put aside the new Ambush Bug compendium for Leonard.
Friday night: Matt Weinstein, an old Berkeley pal, came to town, so I met him and some friends of his at The Silent H, a shockingly good Vietnamese place in Williamsburg. At Queensboro Plaza on the way there, I talked to a guy who was reading Cryptonomicon on the platform, and envied aloud that he's on his first reading. At the restaurant I met a Captain-Hammer-shirt-wearing friend of his who cemented his worth by trading Cryptonomicon references and quotes with me for twenty minutes.
This morning: breakfast and The Met with Anne and her sister Sarah, Anne being a woman I met online when I sought WisCon attendees who'd let me sleep on their floors. We got along great and I'm sure I'll learn a lot about scifi fandom from her. At my place, this evening, I did some career coaching with my friend Rebecca and helped her improve her LinkedIn profile.
In conclusion, dorkiness got me everything I adore in my life.
# (3) 02 Apr 2009, 08:35AM: If You Read This To The End You Get To See Inside My Marriage:
I watched the interview Jon Stewart did with Jim Cramer a few weeks ago. If you're the kind of person who loves Jon Stewart's work, you probably heard about it.
Stewart's key critiques of CNBC:
Financial news that focuses on short term profits and stock tips is an unhealthy market force. Financial reporting has a responsibility to be skeptical of too-good-to-be-true profits and investigate companies and trends that produce them. Finance experts who know about a house of cards have a responsibility to tell the public. It's irresponsible to cheerlead unsustainable bull markets, persuading laypeople to invest in "responsible" retirement plans, then blame evil CEOs and weak regulators after the inevitable crash. Saying people can get wealth without doing work to create value is disingenuous and possibly criminal.
Salon followed up on many of these substantive critiques, not just following the blast and noise of Media Titan Confrontation. "On "Mad Money," Cramer back to normal": he was contrite on the Daily Show, then the next day he minimized the whole thing and kept on doing his normal schtick. More insidiously,
"There's nothing unique about Jim Cramer: The mindless complicity in disseminating false claims is not aberrational media behavior; it is, as they acknowledge, the crux of what they do." Greenwald compares recent finance reporting to prewar Iraq reporting.*
Stewart's most controversial point, and one that hasn't been discussed as much in the mass media, is in the last part of my summary: cheerleading unsustainable bull markets, and encouraging investment rather than work as a way to wealth, is wrong. His words:
But isn't that part of the problem? Selling this idea that you don't have to do anything. Anytime you sell people the idea that sit back and you'll get 10 to 20 percent on your money, don't you always know that that's going to be a lie? When are we going to realize in this country that our wealth is work. That we're workers and by selling this idea that of "Hey man, I'll teach you how to be rich," how is that any different than an infomercial?
"Our wealth is work...we're workers." I asked Leonard to help me figure out why, when a political candidate praises work and workers, it sounds like cant, but Stewart's phrasing felt subversive. He pointed out that the word "workers" and identification with the working class remind people of Marxism. Oh yeah, that. Also, "wealth" usually means earnings and/or capital -- cash, real estate, securities, some financial instrument or an item that can be sold in the open market for cash. But Stewart is saying that our wealth, the prize that we've earned, isn't money, but our ability to earn money. Our asset is the ability to create assets.
Again, identification with the working class. But it's a short step from that to rabble-raising populist demagoguery, which Stewart and Colbert make fun of. A lot. Possibly while engaging in it.
'You say ... I want to keep this homicidal fury forever!' [side-annotation: Hysteria, Our Only Growth Industry] 'But, Stephen, your Thunderdome idea will kill all the CEOs, and there'll be no one left to force through the man-sized paper shredder!' But I say: we will never run out of scapegoats. Because if we focus on pitchforks and vengeance, instead of the fundamental problems that got us here, soon, we'll have plenty of new criminal banks and irresponsible CEOs to start all over again. And we can cry 'Off with their heads!' -- and we'll never have to keep ours.
I get annoyed that the TDS/TCR audience cheers so loud, gilding the lily at every punchline. But sometimes their silence is a tell. When Stewart tossed off that key phrase, "our wealth is work," and when Colbert made his point about scapegoating, the audience was too stunned to clap. This reminds me of a similar moment from Colbert's interview with Daniel Gilbert, happiness expert, June 27, 2007, about 3:45 into the interview:
DG: "It turns out that kids have a very small effect on people's happiness, and the effect tends to be negative. But you'd be happy to hear-"
SC: "Wait wait wait..."
DG: "Well, it means that people with children tend to be a little less happy than people without them, and the more children they have, the less happy they turn out to be."
SC: "Now, are you confusing happiness with the feeling of the sublime? Because children are a pain in the ass. Okay, I'll grant you that. But the feeling that comes with children, I have found, is a feeling of -- that is superior to happiness."
DG: "Yeah, of course."
SC: "That is the sublime feeling. And the sublime comes from beauty."
DG: "The happiness that children give you is a little like the refrigerator light. Every time you look, it's on. Every time you think about your kids, you're happy. The problem is, they're a pain in the ass more often than you're thinking about them."
SC: "Well, that's interesting."
So this is a big shaggy dog story where I end up trying to convince Leonard, who enjoys Colbert but doesn't like to watch the interviews, to start watching the whole show. Because sometimes stuff like that comes out, where you see the real Colbert peek through, this witty improv-loving geek with a background in Catholicism and Tolkien. Basically, it's the Brendan Leonard show!
* Salon, ProPublica, New Assignment, and similar ventures are trying to do good journalism that avoids the inherent blindspots of traditional mass media. In a similar vein, I'm fond of Fred Clark's suggestion that a Work section replace the Business section.
# (7) 01 Apr 2009, 09:17AM: New Awesome Work:
Martin and I are co-founding a new firm to produce the PoTeaTo, a food-and-beverage convergence device targeted at the United Kingdom and the Republic of Ireland. Simply drop the PoTeaTo into a small pot of boiling water and watch the seam split, revealing two pre-blanched potato halves and one strong teabag! Boil them together and you'll have a meal and the drink to go with it.
Just kidding. Actually, starting in a couple of weeks, I'll be working at Collabora, an open source consulting firm. I'll be managing projects and helping them develop awesome tools like the Telepathy framework and the Empathy instant messaging/IRC/VoIP/video chat application. Yes, people are using the phrase "Skype-killer."
I'll get to telecommute (casual day every day!), advance the cause of Free/Libre/Open Source Software, and facilitate the work of dozens of geeky colleagues around the world.
Exciting! The PoTeaTo shall have to wait (in a dry, dark, cool place).
# 01 Apr 2009, 07:40AM: The Long View:
Throughout Jody Procter's memoir Toil: Building Yourself, a diary of his work helping build one specific house in a small Oregon city, Procter aches for the weekend, feels hopeful and buoyant working through Friday afternoon, and buys himself little treats at the 7-11 on the Friday drive home. The rhythm of building tension and weekly release thrums over and over again. The end of the March 17th entry:
I have been taking my watch off or leaving it in the car to try to keep from looking at it. 10:56. 2:05. Seeing those dead hours in the middle of the day demoralizes me. Now, this afternoon, I put my watch on, the better to savor the slow pace of the last hour and a half of the week. The sun has disappeared. The clouds rolls in. A few sprinkles fall and the air is cool and fragrant with the budding flowers of spring and the moist, freshly cut grass of the golf course. I am happier and happier as the final minutes of the work week tick by.
On my drive home I think, if you could only bottle that Friday after-work feeling and sell it to people, you could make so much money you could stop work and then you would never have that Friday after-work feeling again. Unless you indulged in your own product. And probably, after a while, you'd get addicted to it, it would lose its kick, it would turn out to have negative side-effects and all would be lost and in ruins. You would lose your fortune and have to go back to work and then some Friday you would be driving home and you would have that Friday after-work feeling all over again.
# 28 Mar 2009, 02:33PM: A Book Review About Leadership:
I mostly wrote this book review in the fall of 2008.
On the Psychology of Military Incompetence
by Norman Dixon
On The Psychology of Military Incompetence is 400 pages long, and worth savoring. Its fundamental question: Given that information is the reduction of uncertainty, how do leaders of different temperaments react to information? The author limits himself to cases of British incompetence in battle, but of course you can extrapolate from that.
Dixon clearly but steadily builds his case against the prewar British military. The one-line summary is: culture stagnates into convention, which drives out the unconventionality you need to succeed. More nuances ahead.
From Skeleton to Prison Cell
Dixon shows that to advance in the British armed forces, in peacetime, demanded rule-following and an authoritarian mindset. But the mission of a military is to win wars, and that requires fluidity and a willingness to take risks -- and offend superiors.
So, what happened when peacetime promotions hit a war zone? Disaster -- in the Crimea, in southern Africa, all over Europe in the First World War, over and over again. Soldiers' courage and tenacity get their generals out of the holes they dig.
In general, institutions get the leaders who fit into those institutions and succeed at the unstated goals (for example, avoid retreats at all cost, impress politicians, keep civilians uninformed and complacent). If the unstated goals don't line up with the institution's stated goals, then leaders will tend to do the things they've been rewarded for in the past, especially in moments of high stress and low certainty. Therefore, in battle, bad commanders freeze up, wait for orders, ignore new information to appear "decisive," give panicked and contradictory orders, lie to maintain their personal reputations, and so on. And disaster happens, over and over again.
In Dixon's view, the British military suffered from groupthink and valued particular upper-class traits over merit. It's astonishing that military personnel would need to be told that the map is not the territory, the signifier not the signified, but indeed they cared more about the signs and forms of morale and professionalism (such as clean clothes and polished brass) than about warm clothes, edible food, and working equipment.
Narcotic Assumptions, Lenses & Blinders
I'm in India as I write this and dealing with my own need for shiny appearances. I often forget, once I return to the States, that I find -- for example -- hermetically sealed bathrooms reassuring. My parents live in a home where the plumbing and electrical work aren't consistently hidden beneath stucco and sideboards, and it surprises me how much that bothers me. I haven't seen any marked crosswalks in their city, either; we watch for a lull in the bicycles, mopeds, and rickshaws, then rush over the dusty, rocky street. No accidents yet.
I consciously desire function over form, but that only works if I can convince myself to rely on an ugly-looking system to work.
I calm myself with a fallacious appeal to statistics: if something's wrong, it would have broken already. If other people depend on similarly rickety-looking setups, then they must be dependable. Or I just go straight to infantilism and believe my parents wouldn't put me in danger.
Seth Godin recently wrote about the "edifice complex". He reminded us that, in times of uncertainty and stretched budgets, when we can least afford the "organized waste" of facades, we find them most reassuring.
In good times, insecurities and rationalizations like mine are a luxury. In battle and competition, they're delectable poison.
British commanders, similarly, clung to the false clarity of their chain of command, "masculinity," pride, and privileges when they faced the mess of battle. They feared shame more than they minded losing men, and they scorned the "motherly" chores (or retreats) that would ensure troop survival and readiness.
Valiant forays are masculine, but feints and retreating are girly? Again, ideology got in the way of success, as when insecure commanders pooh-poohed nonwhite adversaries, self-improvement, and new technology.
The lesson: Real self-confidence doesn't need ideology as a crutch. The flipside: if you see someone leaning on received assumptions, and repeating them rather loudly, it's because without them he wouldn't know who he was.
The argument above takes up most of the book. In an aside, Dixon suggests that "senior commanders have often to fill a number of incompatible roles": heroic leader, military manager, and technocrat, plus politician, PR man, father figure, and therapist. This is of special interest to me.
I've learned models describing styles of leadership: authoritarian, democratic, and whatnot. These days I'm more interested in the balance among managing up, down, and sideways. Reading these books and thinking aloud about them helps me get perspective. What leg of that tripod have I been shorting?
Works thematically related to On the Psychology of Military Incompetence: Dilbert, the Harvard/NASA case study on the Columbia shuttle disaster, and John Le Carre's The Tailor of Panama.
# 27 Mar 2009, 02:46PM: Ada Lovelace Day, Belatedly:
I am abashed and thankful that Rachel and Danny thought to mention me in speaking of women in tech on Ada Lovelace Day. I offer a sidelong glimpse into a short list of my influences Right Now Today:
A woman, my manager at Exodus, a history major or something, whose career path reassured me that CS wasn't the only way into interesting tech jobs. I thank you, Jed, for making a similar point -- QA, tech writing, education, design, sysadmin, and management are damn cool.
Marissa Mayer at Google might be, among other things, Google's Steve Jobs, and inspired me to think more about product design leadership.
Rachel Chalmers, of course.
Mel Chua, who reminds me to learn about how I'm learning, and that my default answer should be "yes, I can do that."
And all my Systers. I thank them for daily popping up in my inbox, being the friendliest forum for questions stupid and subtle, and reminding me that we are legion, diverse, wage slave and entrepreneur bare-metal hacker and CIO and everywhere in between and sideways.
# 09 Mar 2009, 04:13PM: Lego Learning:
When I was rejecting submissions for Thoughtcrime Experiments, I told many writers that I'd give them suggestions for improvements if they wanted them. Some replied and took me up on the offer. Today I'm working on some of those critiques. Suddenly I am interested in litcrit theory and practice, because now that is a tool I can use to help people.
# 28 Sep 2008, 06:11PM: Haze Outside, Malaise Inside:
Seeing old friends makes me feel homesick. Going to more free culture events here may help. Also, distractions! Like HOWTO/memoir books about other professions!
Zac Unger's Working Fire, about a guy who basically leaves academe to become a firefighter, is short, switching between journalist-clear and memoirist-thoughtful. My ex's dad was a firefighter in Stockton, probably still is. When I try to remember what he looked like, I think of my old boss Leonard Pollara of Upper Meadows Farm. I once had Thanksgiving dinner in a firehouse with his family and remember feeling very nervous and out of place. Unger had the same fears but got over them, partly through competence, partly by adapting his social self and making friends.
I'm nearly done with Jane Addams's Twenty Years at Hull House, which chronicle the doubt, missteps, victories, and idealism of the young and middle-aged Chicago community organizer from the turn of the century. I was reassured when Addams talked about her long, hazy post-college period before starting Hull House. I haven't come up with my Big Project yet -- I'm not just waiting to be struck by certainty, I'm searching for what my unique value even is -- and every day I feel like the clock is running out.
# 03 Aug 2008, 10:33PM: Log:
L. Sprague de Camp's entertaining Lest Darkness Fall moves really fast. This is probably true even if you haven't just read a 900-page Neal Stephenson novel. I nearly mentioned Lest Darkness Fall in my brain candy recommendations to danah boyd, but fear it's not trashy enough.
William Ball's A Sense of Direction is fantastic and as soon as I return it to the library you should check it out. As I suspected, it has a mix of great inside baseball on directing plays (e.g., three pages on how to structure and practice curtain calls so that actors don't get their egos in a twist) and transferable advice on managing creative folk.
We learn in threes. The first step of learning is discovering; the second step of learning is testing; and the third step of learning is pattern-setting.
The actor will learn to relinquish his fear when he sees that the director never causes another actor to be frightened.
...a question from an actor is not a question. A question from an actor is an innocent bid to draw the director's attention to something unresolved. When the actor asks a question, a wise director doesn't answer the question. The answer to the question is not in the director; the answer to the question is in the actor. Answer the question by asking another question. Allow the actor to resolve the difficulty. He already has the best answer in mind before he asks the question.
Always begin rehearsal on time. There are some directors who like to gossip and joke and waste the first ten or twelve minutes. This awakens a sense of sloppiness in the actor and gives him the feeling that the work is not important.
For future reference, I'm also a fan of advice on pp 58-59, 66, 102-104, and 108 of the 1984 edition.
This weekend (among other activities) I went to a fun party, watched a lot of Babylon 5, saw a friend's wife and new baby, read the de Camp, ate Leonard's excellent sour cherry cobbler, walked around a lot, filed a bug or two on Miro, and rented movies to foist on my fellow jurors this last week of grand jury duty. All this and I still spent hours dinking around on the Web. So there, anxieties!
# 23 Apr 2008, 03:27PM: Questionnaire For Vendors:
We got a demo of a fancy new web-based software tool -- project management, task tracking, bug tracking, collaboration, Agile, Extreme Programming, a singing, dancing, iterating revue. I know a little something about the tradeoffs that creators of collaboration tools have to make. So I could ask pesky questions like:
- Do you host it, or do we have to? If the latter, what sort of server, database, etc. do you recommend we set up? On average, how long does it take a customer of yours to set that up?
- What's customizable and what's one-size-fits-all? For example, does using your application require that the user fill out certain fields for every task, and does the administrator configure that? On average, how long does it take a customer of yours to choose and configure the customizable parts? (You can't have both off-the-shelf and customized.)
- What's performance like? (Unfortunately, to check their reply, you have to play around with an instance or installation that has a lot of data in it. See if the vendor has a trial version that comes with sample projects.)
- What browsers do you support? (If you have people in your organization dedicated to Opera or Konqueror or iCab, see if the creators of this app have even heard of them.) What versions? (Watch out for IE7 and Vista issues!)
- If someone assigns a task to me, how do I find out? Email? RSS notification? Or do I have to keep this web application open all the time to find out whether I'm the bottleneck keeping us from meeting our commitments?!
- What's not so great about your application? Related: When do you recommend we not use your application? (I answered this honestly when I worked sales, so I want a straight answer when I ask it. Salon.com wasn't for those who can't stand reading on a screen, or have no free time. FogBugz wasn't for secretive organizations with six levels of security, or time-rich, money-poor hackers. You'll gain credibility and customer satisfaction if you're upfront about who's not your target market and why. If you think you've made the One True collaboration tool, perfect for all niches, then you need to get honest with yourself about the architectural choices embedded in the product you're selling.)
- What do I lose in switching to your tool? (Example: you'll lose the tactile intuition of the index cards you use for Agile planning. You'll lose the ability to destroy code or documentation without leaving a trace. But that's worth it because...)
- What decisions does your tool make easier?
- Does your product integrate with...? Twitter, SharePoint, Subversion, FogBugz, AIM, Outlook, Microsoft Word's Track Changes, iPhones, BlackBerries, Asterisk, Basecamp, TickSpot, Crystal Reports, Time Machine? And if the vendor says yes: How does the integration work? (Example: If half your staff have iPhones, then check whether "integration" means "the site works on iPhones" or "iPhone users can use a special iPhone-optimized version of the site." If you use FogBugz, there's a difference between "we'll email new issues into your FogBugz installation" and "the site makes extensive use of the FogBugz API.")
- How do I get ALL my data OUT? (Best answer: "You always have access to all your data in [common, open-protocol format] and can export and archive it at any time by clicking this link." If you don't want to act like you're already thinking about lock-in and the endgame, just say you need regular archives as part of your backup system.)
- What's your upgrade history? When was the last upgrade, and when is the next one? (Check this, the release notes, and whether an ecology of plugins exists around the tool.)
I don't think the vendor liked that I was asking these questions. I got the nervous-laughter/"That's a very good question" combo twice. Good sign.
I can come up with more such questions for vendors in case anyone feels like lengthening their checklists. Share yours in the comments.
# (3) 05 Jan 2008, 02:10PM: Gems:
I post lots of little links in the del.icio.us account that Leonard and I share, and that keeps this blog from just being a mass of commentless links. But every once in a while I wish to celebrate bits of the net with/at you. Here!
If you can't get enough Randall Munroe, his LiveJournal should absorb you for ten to twenty minutes. Munroe's experience of Cryptonomicon and mine concur: "I keep picking it up to glance through and then accidentally reading through to the end." Sadly, Knuth, Stephenson, et al. are probably too busy with their magna opera to enjoy the thrice-weekly distraction of Munroe's work.
The soldiers' truce of 1914 -- I knew about it, but it turns out I didn't know a tenth of the story. Tremendous.
And, in a discovery almost certainly irrelevant to your life and to mine, I think Pseudonymous Kid's mom's dad lives where I used to live.
But the real hot tip of this entry is Yishan Wong's Reddit comments. Wong works at Facebook, his wife just had a baby, and I'd rather read his comments on Reddit than blog posts by jwz or Steve Yegge. Examples:
Abortion clinic bombers are the only terrorists who can accurately be described as "hating us for our freedoms."....
It's not one bad programmer. PHP makes bad programmers worse, but it also forces good programmers to have to be kind of bad just to get things working "okay."
What's remarkable about PHP is that it's the best PHP programmers who are the ones most vocal about how awful it is....
Just for irony's sake, I use [the powerful chip in the Sony PlayStation 3] to crack the encryption on my Blu-Ray discs.....
But the bit I really love, the bit that throws Paul Graham into the water, is Wong's
encouragement and HOWTO on learning to work hard.
...One bonus effect is that you learn what smartness really does for you: it's a multiplier. It doesn't give you success for nothing (i.e. 5000 x 0 = 0), but if you apply smarts to a work ethic, your output is multiplied (i.e. 5000 x 10 = 50000). So a smart person who learns to work hard benefits far more than a mediocre person who works hard.
This benefit becomes very addictive: "whoa, by sheer force of will I can essentially call into being wealth for myself!" and that's what keeps you from backsliding....
That's going on my reread-regularly list.
# 13 Jul 2007, 03:17PM: Here We Go:
In this week's MC Masala column, Leonard talks about making pesto, and I talk about the Indian tulsi plant.
Leonard used the garden as a trick to get himself to exercise. His hours of plantings,
weedings, waterings and harvests yielded about five meals' worth of food. But he still
remembers sharing those green beans with our neighbors. And that yard went from dead gray
dirt, where not even weeds grew, to a beautiful green/brown profusion.
My mom gardened everywhere she lived, too. I remember the flowers best. All our houses
smelled of jasmine -- Leonard included a jasmine vine in our backyard to make me happy.
But she always made sure to grow one herb: Tulsi, or 'holy basil.' We ate it and we used
it in Hindu ceremonies. No wonder I latched onto its cousin, the sweet basil that we
usually mean when we say 'basil.'
I finished Neal Stephenson's The Baroque Cycle. As always, some nice metaphors and insights, but I didn't get enough jaw-dropping moments out of the thing, and it got to the point where any clump of description longer than a few sentences tripped me up. Still: an awesome achievement, and the dialogue where Daniel Waterhouse meets Mr. Orney is deadly hilarious. Also, I recently read Isaac Asimov's crazy Murder at the ABA. Harlan Ellison didn't sue for libel?! And An American's Guide to Doing Business in China: Negotiating Contracts And Agreements; Understanding Culture And Customs; Marketing Products And Services by Mike Saxon is fascinating, especially in the vivid, deep, broad stereotypes of China and the Chinese.
I'm off for two weeks for my own exercise and green/brown profusion. Via WWOOF, I'll be working on an organic farm a ways northwest of here. Mostly tending tomatoes, I believe. I got a sun hat and some shreddable shorts and jeans at the thrift store. I leave tomorrow. If my schemes work out I'll still get a copy of the seventh Harry Potter book the day it comes out and read it before spoilers get to me. Also if my schemes work out my first time ever doing agricultural work will not maim or kill me.
# (1) 30 May 2007, 10:27AM: Tip For Keeping Resume To One Page:
Copied and mildly edited from my comment yesterday on the Joel On Software discussion board. The original poster, two years out of college, had asked whether to keep his college internships on his resume - and if so, how could he keep the resume down to one page?
Like any fairly ambitious person your age, you've got enough accomplishments, internships, gigs, volunteering, awards, etc. to fill at least two resume pages (reasonably typeset). That's great. So create that and keep it updated. That's your mega-resume. For each job, you have several bullet points listing all your tangible accomplishments and regular tasks you performed.
Then, for each individual job that you apply to, distill down a relevant one-page resume, with each item specifically selected for the job description and the research you've done on the organization. (You label your past gigs as "Selected Work Experience" so it's clear that this isn't all you've done. "Additional work experience and references available on request" is the last line.)
Once you're distilling a new resume for each job application, you clearly see that sometimes you should include internships, and sometimes another experience earns that space on the page. By the time you're 7-10 years out of college, you'll almost never find space for an internship on the one-pager.
If you're lacking space for a particular one-pager but want to convey your leadership skills, your experience in teaching could go in your "skills" section.
A few slightly off-topic tips:
1) Acquaintances and friends of friends are a better source than posted job ads. Talk to the most connected tech people you know, even if they're just acquaintances, and ask them to keep their ears open for opportunities for you. A personal introduction is a less brittle stepping stone than a resume.
2) Your mileage may vary, but the fact that I put "stand-up comedy" in my public speaking skills/experience line on my resume has piqued hirers' interest more than once. If you have a non-creepy hobby where you've accomplished a lot, think about putting it in the Skills section.
# 27 Apr 2007, 08:30PM: Trepidation And Excitement:
Today at work I got to coordinate the creation of a neat thing. That excited me. Tomorrow I defend the first chapter of my product proposal for my master's degree. That's more scary.
# 22 Apr 2007, 10:16AM: Straw Men:
Did I ever tell you about the striped straw experiment and deciding to be happy? From a column I wrote about a year ago:
...straw fortune-telling, or bendymancy. For breakfast every school morning, I had a bagel with melted Velveeta and a cup of Carnation Instant Breakfast -- not the complete and nutritious meal that my mother would have preferred.
I drank the shake through a straw (Bendy, not Krazy -- after all, I wasn't a baby). Mom bought these straws in 500-packs from the Pak 'n' Save, which printed grocery packing directions on its brown paper bags, headlined with the educational but dismissive "Pack Your Own Savings!"
These white straws came with assorted stripe colors, one quarter of the box was red, one yellow, one blue and one green. I decided that the stripe color of the straw I randomly chose would foretell the quality of my day. Red was horrible, yellow was unpleasant, blue was good and green was great.
And if that makes sense to you, you should read Mark Haddon's "The Curious Incident of the Dog in the Night-Time," in which an autistic boy decides to make up his own fortune-telling superstition.
Even if I knew it was all fake, even if I drew a red-and-white straw, at least it gave me a worldview, some resignation or confidence so I could frame the events of the day.
The things I decide to do on my own feel so much better. Learning a bit of Scheme, exercising, going to church, climbing a rock, whatever -- the very self-direction makes them taste sweeter. But I still need another person's support or company to keep doing them. So that's one balance to hit.
I learn skills best when I've created a goal that I sincerely want and that requires those skills. Until I want that goal, it's useless. But what do I want? Desire and agency feel so far away, even though I have demonstrably chosen things towards certain preferences. All I consciously own are the lower-order needs. I'll second-guess any consciousness of ambition. What makes me feel joy, just for a moment, is fulfilling the ambition that I'm too suspicious of -- and too enamored of laziness masquerading as rat-race-avoiding contentment -- to wholeheartedly chase.
The world is not finished. I'll never master things. How is it that some people find that energizing? I can understand how existentialism turns some to nihilism and some to humanism. I think I'm struggling along, finding some structures readymade and creating some, awkwardly, secretively, on my own. I feel less like an oak and more like ivy seeking a trellis, even though sometimes I dare to look down and can't quite see the scaffolding I've assumed was there.
[Update: Nothing is finished, and that is a comfort because that means we haven't permanently failed, either.]
# 21 Apr 2007, 12:14PM: Between Transparency And The Paywall:
You are important. You are worthwhile. Your time and effort have value. Right now, a very good way to indicate and articulate and leverage your value is by making sure you get money in return. And it is okay to make more than you absolutely need.
From The West Wing:
Josh Lyman: I know that you can parlay the Santos win into a doubling of your fee.
Louise Thornton: Tripling, if it figures into your memoirs.
Josh Lyman: Nothing is going to top this. Everything else's going to be a letdown.
Louise Thornton: Letdowns that make me semi-rich, that's a tradeoff I'm willing to endure.
Josh Lyman: You don't care about money.
Louise Thornton: Who doesn't?
Josh Lyman: You!
Louise Thornton: Not as such.
Josh Lyman: As what?
Louise Thornton: Scorekeeping. Quantitative evidence that I'm smarter than you. (Not YOU.)
Josh Lyman: Who?
Louise Thornton: Everybody else.
Prices send signals; one way for me to make sure Salon valued me was to get them to give me a raise. "Doing things that make work rewarding and pleasant is the most important part of attracting people." Once I'd hit the ceiling at Salon, and the work wasn't rewarding or pleasant anymore, I started looking for other work. But in the meantime, I got a raise from Salon to compensate me for my experience, value, and not-leaving-ness.
The easiest way to get a raise is to get a new job; a big jump in pay happens easier when you first get hired, while you still seem shiny and exotic and new to the new employer. But if you can get a raise from your existing employer, then the new employer will have to raise it to get you. So I make as much as I do at Fog Creek partly because I got that raise at Salon. Salaries accumulate over time, like compound interest, so getting up the ladder has long-term effects.
John Scalzi talks about how much he makes and talks about why he talks about it. I don't feel comfortable talking on the web about all of my finances without asking my husband first, because they are now his finances too. But I will tell you that I make $75 per column for my weekly MC Masala gig, and that I'd like to be making more from that, since I have delivered for two years now and built up a small fanbase and have a circulation in the hundreds of thousands. This summer I'd like to seriously look into syndication.
The more information we wage-earners and freelancers share, the better we can negotiate with the employers. Whom does it benefit when we are reticent in disclosing the pay scale of the world?
# (3) 17 Apr 2007, 10:34AM: Riddle Me This:
I work in a software firm. I am the only person there, except the office manager, who is not a born-and-bred computer geek. They play video games all the time. Yet I'm the only one who regularly walks in reading comic books, and who makes Star Trek references that no one understands at the lunch table. Worst....stereotype....ever.
Note on my objective weirdness: I've also been bringing in MAD Magazine to put next to Linux Journal for bathroom reading.
# 03 Apr 2007, 12:17PM: Anatomy And Andragogy:
Yesterday, I sat down over coffee with the Fog Creek system administrator and learned how a specific piece of our network architecture works. As he talked and I asked questions and tried saying things in my own words, and we drew diagrams and annotated them, I learned something about how I try to understand a complex system.
- First: the big parts/components and their functions.
- Next: understand the desired and usual flow of data/blood, from entering the system to exiting it. Here I try to see things from the perspective of a single data packet, blood cell, or what have you.
- Next: what's enforcing the rules, and what's pushing the data/blood through the system? What are possible attacks or failure points? And what defenses are built in to resist or recover from attacks or failures?
Without even meaning to, I was taking Neal Stephenson's advice to heart:
Windows 95 and MacOS are products, contrived by engineers in the service of specific companies. Unix, by contrast, is not so much a product as it is a painstakingly compiled oral history of the hacker subculture. It is our Gilgamesh epic....
...Unix has slowly accreted around a simple kernel and acquired a kind of complexity and asymmetry about it that is organic, like the roots of a tree, or the branchings of a coronary artery. Understanding it is more like anatomy than physics.
--Neal Stephenson, "In The Beginning Was The Command Line" (1999)
So I've articulated a possible plan of attack for learning computer-related architectures. Another: just dig in! Try something small and concrete, and learn as you go. But I've found that, once I try to do anything even mildly complicated with OSes, filesystems, networks, and what have you, I get quite uncomfortable unless I can find out the structure and foundations of the domain. So now would be a good time for me to take classes in data structures, algorithms, networking and architecture, etc. Maybe I'll make my own summer crash course.
# 08 Feb 2007, 09:12AM: Minimalism:
Just got off the column for this Sunday. Something I had to leave out: Mike Daisey wrote about his time at Amazon in his book 21 Dog Years (based on his monologue) and talked about dot-coms and minimalism in architecture for a paragraph.
I don't know what it is about tech companies and exposed ductwork -- they love the stuff. It's as though the building's guts reflect an inner anxiety writ large, so that at any point in the day any of us can look up at the exposed piping and exclaim, "We're so busy, look how hard we're working...oh God, please, we're almost profitable, we're working so hard that we don't have time to cover up these ducts! They had to be exposed! That's how dedicated we are!"
# 03 Feb 2007, 09:11PM: To Optimize Response Speed On MySQL, Follow These Instructions:
Just watched Jay Pipes's 45-minute Google TechTalk, "Performance Tuning Best Practices for MySQL". A few points I took to heart:
I've just listed a few of the best tips. If you deal with MySQL for fun or profit, check out the talk.
# 28 Nov 2006, 05:04PM: Tech Concerns Great And Small:
David Stutz's essay on commoditization, software platforms, and the law of "the conservation of attractive profits" reminds me: software is profitable when it is flawed. This is because flawed software allows you to charge for bugfixes and new features, and because flawed software is an indication that the state of the art does not yet solve customers' needs, so they are hungry and it's a seller's market.
Today I've been working with Microsoft SQL Server Management Studio Express for the first time. This is actually my first time getting my hands dirty with any of the Microsoft database management applications; I've used phpMyAdmin to talk to a MySQL database, but that's all. Microsoft has a reputation for doing exactly what Stutz is talking about. Create a barely adequate product and get people using it, charge them for upgrades, and create a strong network effect barring market entry. Turn your technology into the platform that other people build on, by default. Collect rent.
But my recent experiences with IIS, SQL Server, and other grown-up-ish Microsoft technologies are cooling my old Slashdottian zealotry. I'm like Randy Waterhouse reluctantly recommending Windows NT to his oral surgeon. Troubleshooting in Windows involves undocumented API changes, wizards that improperly wiz, and unchecked-by-default checkboxes nested four deep in configuration dialogs. But Unix troubleshooting involves poorly documented application changes, path and permission trip-ups, and dependency hell spanning kernel, utilities, and the million micro-layer tools that connect it all. I don't know which I prefer, and that's weird to me.
I haven't gathered enough data yet to tell whether I prefer phpMyAdmin to SQL Server Management Studio, although a few inherent advantages of desktop-based apps over web apps might prevail here (see the last few paragraphs of my boss's lament).
Pop quiz: does the CREATE TABLE query that makes a table with a composite primary key (a tuple in this case) include the crucial word COMPOSITE in it anywhere? The answer is no! In case you're flipping through Ben Forta's SAMS book Teach Yourself SQL in 10 Minutes, Second Edition, you might find this useful:
CREATE TABLE OrderItems
order_num INTEGER NOT NULL References Orders(order_num),
order_item INTEGER NOT NULL,
prod_id CHAR(10) NOT NULL References Products(prod_id),
quantity INTEGER NOT NULL,
item_price MONEY NOT NULL
PRIMARY KEY (order_num, order_item)
That might only work in SQL Server Management Studio, though.
I use various applications that call themselves "managers." SQL Server Management Studio, Adobe Download Manager, Mozilla's Profile Manager, what have you. They aggregate and maintain functionality and they're useful. But their names make it sound as though "managing" software is just a matter of checkboxes in the here and now, and not messy strategizing towards an unseeable horizon.
# (1) 01 Nov 2006, 11:30AM: Decision Theories:
Avoiding Projects Pursued By Morons 101:
There is much made by people who long for the days of their fourth form debating society about the fallacy of "argumentum ad hominem". There is, as I have mentioned in the past, no fancy Latin term for the fallacy of "giving known liars the benefit of the doubt", but it is in my view a much greater source of avoidable error in the world. Audit is meant to protect us from this, which is why audit is so important.
Avoiding hiring morons:
If the basic concepts aren't so easy that you don't even have to think about them, you're not going to get the big concepts....
You see, if you can't whiz through the easy stuff at 100 m.p.h., you're never gonna get the advanced stuff.
# 10 Aug 2006, 03:54PM: In The Application Of My Seat To A Yoga Mat:
Once upon a time, my brother-in-law-in-law wrote a bit about working out, Daylight Savings Time, doing stuff alone, and same-sex marriage. John's an interesting guy, and I find all of those topics worth exploring, but right now fitness weighs heavy on my mind.
My sedentary lifestyle and love of candy and Leonard's food have caught up with me, so now I'm actively working to increase my fitness and stamina and decrease the amount of room and mass that I take up. Both my parents have diabetes; I've started thinking long-term.
I started a TiVo Season Pass to a show on Lifetime, Denise Austin's Daily Workout. Denise Austin is a Mr. Rogers-style workout coach. At least two other people have blogged about the humorous incongruity between her sweet, friendly encouragement and the pain of working out. But any personal or impersonal trainer will evince that sort of thing. Two things that I find weird about Austin:
- She publicly and strongly supports George W. Bush, which makes me wonder about the science she spouts about metabolism, calories, etc. Does she think human-caused global warming is some unproven hypothesis?
- She was born in 1957, yet looks younger than I do. Not just her body, but her face looks about twenty years old.
But she doesn't creep me out, and I like the workouts.
Food, sex, money, the body: all these fraught topics disappear if I wholly involve myself in something. This works even if the activity centers on one of those topics. If I let the milquetoast Daily Workout electronica energize me and get my kicks higher and higher, I can escape. As I get better at gaming my body, I hope exercise escapism approaches the quality of literature escapism and comedy escapism.
I have been daniel.u ("I feel like my body is a station wagon in which I drive my brain around...") and now I'm stopping. Once I get the hang of remembering that I'm a physical organism, I'll incrementally improve at living consciously in my body, but right now it's triage. Get up and moving every day. Stop eating tons of starch. Stop eating free candy at work. (Now that I haven't had candy at work for weeks, sometimes I crave it, but sometimes I can't imagine eating handfuls every day, as some coworkers do, and as I used to.)
Perfect is the enemy of good, or done; half a loaf is better than none; doing something, for me, here, is better than doing nothing. I haven't joined the rapid prototyping cult, but I understand them better now.
# 30 Jul 2006, 08:30PM: Marissa Mayer & I Both Use Pine:
Over the past week I've been to three different tech-related meetsup. I went to an EFF-NYC group, I helped host the Fog Creek open house, and I visited the Joel On Software discussion forum meetup in lieu of my traditional Saturday night SKP visit. It'll be a good yield if I get two lasting friends out of the whole trilogy. Today I played the hermit, rereading America: The Book and bits of Jane Eyre in between working on my column and playing Tetris with my husband.
I've spent half a year with Fog Creek now, and I know its strengths and weaknesses almost as well as I know my own. I've just downloaded a bunch of Audiofile songs and the music makes me pensive. I'm wondering what it'll take for me to become an IT leader with soul and cred.
Do I have to be a tall blue-eyed blonde with patents in artificial intelligence? Is it that or Fiorinadom? Is it possible to feel like a completely lost pioneer and a cliché sellout at the same time? That sort of thing.
By the way, the Joel on Software jobs board has been hopping lately, and my boss has been blogging at unusually high volume.
Anyway, back to my columns. One is about times I've been truly happy. I think the other is about practice, craftsmanship, and the tradeoffs one makes to live a satisfying life. But I'm not sure yet.
# 13 Jul 2006, 07:38AM: And Hanging On The Car Door Handle Was...A NetNanny!:
Want to hear a horror story about control freak managers?
...The engineers were placed out of the loop regarding what was happening in the standards committee and when they finally agreed on a standard, our hardware could not support it....
# 21 May 2006, 02:30PM: The Customer Is Always The Customer:
Sometimes I wish I could defend "Keep it Simple, Stupid" with flair and confidence to people who think they need things that they probably don't. Folks who say "the customer is always right" have almost never worked retail. 99% of the customers are right; the 1% that are incandescently wrong bat off all attempts at reasonableness.
How do you kindly tell a prospective customer, "You are looking for something that our product does not and will not do"? It helps if you weren't trying to sell your product in the first place. Christopher Petrilli, a user of the open-source bugtracker Trac, writes about its ease of use and consequent design tradeoffs.
Honestly, if you can't trust your developers to set the box on a
ticket to the right setting and need a nanny to do this for you, then
you have problems infinately worse than lack of "workflow".....
Just my two cents, but if this is your "deciding factor," then I think
you need to re-think your evaluation priorities......
Again, Trac isn't all-things-to-all-people, and so if you absosmurfly
must have a formal workflow system, then I suspect you're going to
need to look elsewhere.
Basically, I have been doing corporate customer service long enough that I find clear and straightforward "We won't do that and your premises are wrong" answers extraordinarily refreshing. I'm still trying to figure out why the Trac and PuTTY examples feel fresh and the 37 Signals "It Just Doesn't Matter" post feels grating and arrogant.
# 14 Apr 2006, 11:07PM GMT+5:30: No One Has a Calling Anymore, Just A Core Competence:
All this time I thought I was a multiply-layered intersecting matrix of identities, and all this time I was actually a seven-word elevator pitch.
# 02 Apr 2006, 10:36AM: Does Anyone (Who Writes This Blog) Have Anything Worth Saying Anymore?:
Leonard and I were reading a really interesting comments thread comparing the advantages of tech publishing models in the middle of last week. Against all odds, it stayed almost entirely informative, polite, and well-written. Then:
God, it's all such a bunch of s***. It's hard to believe that anyone is buying stuff from either self-publishing or the mainstream press. The tech world, and the literature world has become so faddish.
Does anyone have anything worth saying anymore?
I'm trying to learn to deal with geeks. I thought they were like my friends, Zack and Seth and Leonard and Joe and Eric and Devin and Zed and Brendan and Riana and too many names to reel off. And the people at Fog Creek are also of this type and I can communicate with them. But somehow I selected for something -- compassion? well-roundedness? a lack of arrogance? -- and now I have to learn how to talk and work with these people, this other species.
The geeks I'm running into socially here are almost all white guys, probably wealthier than me, usually older than me, and they treat feelings and uncertainty as irrelevant distractions. I believe that there's a difference between not caring what people think and not caring how people feel; this distinction eludes many of my new acquaintances. And forget about showing vulnerability! Their neat and easy distinction between their ideas and their selves means that I'm never talking to them, can never affect them one way or another. For all I know, they were born on third base (hitting the lottery in the Punnet Square of machine intelligence) and think they hit a triple. And I've gotten halfway through Glen's Leading Geeks and Duncan's The Career Programmer: Guerilla Tactics for an Imperfect World and they make me want to run for the hills. Am I choosing to spend the rest of my life working with misanthropic, nitpicking jerks?
Part of me wants to be productive and useful, to engage with the Other. After all, isn't this what I have to do? I'll have to work with this personality type for the rest of my life; shouldn't I resign myself and acclimate? And part of me is yelling, loud enough that it interferes, "God, it's all such a bunch of s***!"
Rachel has an awesome career that I could imagine having someday. But I would still have to show compassion for and empathize with people who never return the favor. The more I can understand and work with them, the more like them I become, and I want to keep that part of me that doesn't act like a machine intact. Irrational, non-adversarial, respectful, compassionate stuff is important.
Their arguments keep ringing in my head, the way Ayn Rand's used to, telling me to come over to this utopian paradise where nothing can ever hurt you. After all, they've already won. They set the terms for discourse in the places where I'm going to work if I keep up the career I've chosen. And they think they understand all my arguments and have already proven me wrong.
Or are you so flummoxed and confused and crazy that you decided that what they did made it OK for you to forget the handbook? They're evil, so ... so what? So you get to be evil? Well, of course you get to be evil, but then you're evil. Is that how you envisioned it turning out?
More Jon Carroll, since I'm in that mood:
I mean, render unto me a break. If your family feels so threatened by my family that you think you have to organize a boycott of a car company, then your family has problems my family can do nothing to solve.
I've been reading Jon Carroll archives and lists of April Fool's Day Hoaxes and they make me feel better because they make me laugh. I prefer laughing to arguing with the voices in my head. I miss my friends, I miss San Francisco, I miss the time before I saw mice in my apartments, I miss not caring whether admissions people at major universities saw what I wrote on my blog, I miss thinking that I could get along equally well with suits and geeks. Now I think I get along equally badly with suits and geeks, and that if I want to be a good interface between those two sides, I have to change into someone I don't think I want to be. I feel as though my self is in danger.
I'd say that it'll all be better in the morning, but that's what I thought last night, and this is the morning. But eating might help.
Cogito, Ergo Sumana by Sumana Harihareswara is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License.
Permissions beyond the scope of this license may be available by emailing the author at firstname.lastname@example.org.