Archive for June, 2008

I was once a respected coder. But for 5 years I’d designed ASIC’s using Verilog (where everything happens at once) and then for 5 years I’d turned to business. And it all changes in a decade. I’d let my skills lapse and in the interim C++ had morphed to Java and then suddenly CPU’s got really fast and scripting was back in vogue. 

I realized that my CS undergrad was quickly becoming worthless. Web programming was a complete mystery to me. (Whether that was really a problem is a philosophical question beyond the scope of a humble blog entry). Here is my road to recovery. In bullet point form amenable to PowerPoint and as buzzword compliant as possible.

Jan 1st, 2008: Resolve to brush up on programming skills.

Which language should I learn? Web development seems cool….what’s involved in that? Narrowed it down to a) the LAMP stack or b) Ruby on Rails. Do I want to be a) paid as a programmer or b) hip ?

I went with Hip. Rails it is.

Here are the steps (and mistakes) I took on the road to recovery:

1. Linux – I remember that: “ls -al” and all that. It’s the sine qua non for a real programmer.
2. F@(k. That’s a lot of variants of Linux. Go with Ubuntu because I’m semi-African.
3. Hmm… Windows XP is standard issue at work.
4. Get an old PC from my IT guy. Spend an entire day installing Ubuntu. Realize I’m now a web programmer so start again and install the server version. What the hell? What’s involved with web programming anyway. Will I be writing the client or the server?
5. Call college roommate who is on “tiger team” at Yahoo. He says: “Buy Pickaxe“. Sold. In a flash of environmental sympathy I buy the PDF version. It also saves $10. Print it out on corporate printer. Double sided to save the environment.
6. Need the Rails part: Buy “Agile Web Development with Rails“. We invested in an Agile software company so “agility” must be good.
7. Start reading. In the interest of time and an anxiety to see the global greeting I dispense with Linux and deploy InstantRails on Windows –> Instant gratification. (Nice to see those programmer types have dropped their antipathy towards Microsoft. I’m a web programmer. Even if it’s only on localhost. (Wow: It’s only February and I could compete with Amazon if I wanted to and if I knew where to buy all the books for my bookstore)
8. I have a bookstore up and running. No one can see it. That’s ok….how hard can deployment be.
9. March. Deploytment is hard. People don’t recommend Windows. Could I be the only person writing Ruby code in a Rails environment on Windows XP. Seems to be from my google searches.
10. Let’s reinstall Ubuntu Linux.
11. Install ruby gems. Rinse. Repeat. Rinse. Repeat. Check dependencies. Rinse Repeat. Rinse. Repeat.
12. Install MySQL. (It’s nice that I don’t need to think too much about the database. Seems like something business people should concern themselves with).
13. Stuff is working. Slow as all hell on this ancient PC but what the hell. People will wait for the page to load.
14. Becoming a problem that I can only work on my hobby at work. Can’t afford another PC at home.
15. VMware to the rescue. Downloading an Ubuntu VM on my home PC is a cinch. And hip. Which is important.
16. Realize I need a real hosting service. (Weeks of agonizing research). Settle on Dreamhost. (I love those guys!)
17. Deploy app. Hmmm…this is a f@(k1ng nightmare!
18. Passenger (mod_rails) is released a few days later. I realize I’m back on the cutting edge. Deployment is now piss easy.
19. www.assetcorrelation.com (Live as of June 1st, 2008 — 5 months start to finish)
20. Start to harass Google to show me some organic search love.

It’s been a wild ride. And not as hard as I thought. In the end, we return to the beginning. I still hate writing test benches. Hacking is still fun. And not having deadlines is the way to go. 🙂

I was at a conference this morning where Spansion and Virident were presenting their latest flash memory technology designed to replace DRAM in web servers. Some interesting facts:

1. Cooling and power distribution losses account for 50% of the electricity consumed in US datacenters.
2. Datacenter power use doubled from 2000 to 2005 and will almost double again by 2010. Growth in electricity use has been slowed somewhat by the advent of server virtualization over the last few years.
3. US datacenters use more electricity than countries like Sweden and Iran
4. Datacenters use almost 100 billion kilowatt hours each year at approximately $0.10 per kilowatt hour. Datacenter electricity consumption is growing at 15% per year (!)
5. Datacenter memory (DRAM) uses 2x more electricity than the total capacity of US solar panel installations.
6. US, EU and Japan use 3/4 of the world’s electricity.

It will be interesting to see whether Spansion’s newly announced EcoRAM can put a dent in these problems. They are citing some impressive numbers:

1. 1/5th the power of DRAM at comparable read performance.
2. 800x faster than NAND flash access times.
3. 30 mins to write 1TB of data on EcoRAM vs 5 hours using traditional NOR DIMM’s.

On the other hand, the representatives from Intel and AMD certainly weren’t giving their unqualified support to EcoRAM.

Wired has an excellent article on an optimal memorization algorithm developed by Piotr Wozniak. The technique has been embodied in a software program called SuperMemo and an open-source alternative called Mnemosyne

I’m somewhat skeptical that spending more time on memorizing facts is that useful but given that a few months ago I could barely remember the equation for the roots of a quadratic perhaps I should be more open-minded.

The algorithm is straightforward:

1. Split the knowledge into smallest possible items.
2. With all items associate an E-Factor equal to 2.5.
3. Repeat items using the following intervals:
   I(1):=1
   I(2):=6
   for n>2: I(n):=I(n-1)*EF
   where:
   I(n) – inter-repetition interval after the n-th repetition (in days),
   EF – E-Factor of a given item
   If interval is a fraction, round it up to the nearest integer.
4. After each repetition assess the quality of repetition response in 0-5 grade scale:
   5 – perfect response
   4 – correct response after a hesitation
   3 – correct response recalled with serious difficulty
   2 – incorrect response; where the correct one seemed easy to recall
   1 – incorrect response; the correct one remembered
   0 – complete blackout.
5. After each repetition modify the E-Factor of the recently repeated item according to the formula:
   EF’:=EF+(0.1-(5-q)*(0.08+(5-q)*0.02))
   where:
   EF’ – new value of the E-Factor,
   EF – old value of the E-Factor,
   q – quality of the response in the 0-5 grade scale.
   If EF is less than 1.3 then let EF be 1.3.
6. If the quality response was lower than 3 then start repetitions for the item from the beginning without changing the E-Factor (i.e. use intervals I(1), I(2) etc. as if the item was memorized anew).
7. After each repetition session of a given day repeat again all items that scored below four in the quality assessment. Continue the repetitions until all of these items score at least four.

There is a website called Memverse which has implemented this algorithm for memorizing popular bible verses. I’ve been using the site for about 3 months now and it is very impressive how much you can retain using the algorithm.

There is a promising new website called Asset Correlation which shows the correlation matrix for a host of different asset classes over the past 90 trading days. I have been tracking it for a few months and it is amazing how all the asset classes exhibited far higher correlation during the recent panic. As normalcy has gradually returned to the markets it is interesting to see how the historical scenario of lower correlation between asset classes has returned. A few months ago almost all the cells in the matrix were green and correlations were hovering around 80-90% for most of the major classes. As of today, there is far lower correlation between the classes (indicated by the larger number of yellow and red cells). It will be interesting to keep an eye on this website over the next few months.

Skype has released version 4.0 (beta) and seem to have completely lost the plot on GUI design. In prior versions it was possible to have one’s contact list docked on the right side of the screen leaving plenty of real estate for working. The new layout now takes half of a 21″ monitor and can’t be made any smaller! That now makes it impossible to keep Skype open and periodically monitor online contacts. I would be ok with Skype taking over my screen once a call has started. Before that time, though, it should remain as unobtrusive as possible while still allowing me to monitor my contact list.

Skype needs to realize that our PC’s are not phones. Communication is a means; not an end.

I would recommend staying with Skype 3.8 until this issue is resolved.

I have been using SmugMug for hosting my photos for a while now. There are a few benefits that make it worth the small annual subscription and don’t seem to be available from any of the free offerings:

1. Your friends and family can download photos in full resolution
2. Absolutely zero ads. Not having ads posted alongside your photos makes them look a LOT better.
3. Unlimited storage and quick/easy bulk uploads
4. A personalized URL
5. Backups in 3 states.
6. No need to login to view the photos (strangers really aren’t interested in your photos!)
7. More professional look and feel. This is a website that is used by many pros.

I’ve used SmugMug for three years now and have been extremely happy with all aspects of the service. If you’d like to save $5 on a subscription, enter the following coupon in the ‘Referred by’ field:  LQvt6m1M08vGw