Back online in 5 mins.

Okay, on to the next session: building a twitter clone at high scale.

...and we have a winner.  But it's not me.

If I win, should I donate it to ISV Engineering?

Ooh, there's a drawing for a netbook.  I've got a ticket!

They use ext3, but his choice is HRFS.

(in response to question "What filesystems do you use for your testing?")

"We're not developing on spinning hard disk anymore.  We do all our development on SSDs."

Q&A.

Okay, I'm dialed out.  He's not talking much to his audience; he's talking *at* his audience, or mumbling.

"We've got our OS & X Server startup down from about 4 secs to about 2 secs."  Huh!  really?  Interesting.

showing a chart of booting Moblin OS, seeing how each process takes time launching.

I'm thinking I'll do that one: the twitter clone.  Why?  What's the stack this guy uses to create an app service at high scale.

Building a highly-scalable, open source, twitter clone?

2009 PHP Best Practices?  IronRuby 0.9?  High Perf SQL with PostgreSQL?  MariaDB?

A/V people trying to adjust the projector, but really it's the presenter's slide that's the problem, not the projection.  heh.

What should I see at the 2:35PM session?

Okay, turns out this talk isn't the most compelling ever.  I'm not sure what his point / message is, but give him pts for effort.

<sigh>

Example: "ter algorithms/mechanisms (batching, ...less work).  Use less CPU!"

Example: "rly DNS lookups to a caching DNS ...er"

Example: "ing latency: sreadahead".

"Tricks / Methods" slide: looks like left half is missing, can only see partial words.

Hey folks, I'm back.  Attending a session "Why it is hard to be fast".  http://is.gd/1Jkf2

Back at 1:30PM Pacific, see you then.

If there are any sessions you'd like me to cover, comment right here on the snapcast.  The popular vote wins; I'll cover what you like.

I will be online for the OSCON afternoon sessions, from 1:30PM to 6:00PM.

Hi folks, back for a quick word here:

Good night, folks; see you tomorrow.

Let me know which sessions you want me to attend tomorrow!  I'll do it.  If you don't pick, I will.  I doubt that's good for anybody.

...then taking a break from 10AM to 11AM, back at 11AM.

I'll snapcast the morning keynote at 9:00AM Pacific Time...

I'm going to walk away from the snapcast but I'm back tomorrow morning.

Looks like that's a wrap for the session.

Q&A time.

They're showing a data dump of what the tool does.  I can't follow this part at all.  I'm sure it means something to them, though.  :-)

Horiz. bars are indiv. web page elements; time goes left-to-right, so width of a bar shows how long that page element takes to render.

Just uploaded a screenshot of the tool.  What you're seeing is it graphing the perf of one web page being loaded.

They built a rule that looks for "myspacecdn.com" or "myspace.com", to see how MySpace-friendly a page is, just for fun.

Funky: you can define your own validation rules to apply to any page that MSFast analyzes.

Looking at code in MSFT Visual Studio: the source code for the MSFast perf analyzer.

They also have a validation system: can analyze a page and show parts of the page that are behaving badly (deprecated domains, etc.)

Really nice way of showing perf problems for each element of a complex page.

Wow, pretty cool: the tool shows before & after (visually) for each segment of the page that loads.

x-axis is time elapsed as the page loads.  graph shows CPU load over time, browser memory usage, and load time for each page component.

plug-in for browser loads a page, then shows a graph:

(that's user traffic)

A: 44% is IE 7, Firefox is 16%, missed the IE8 number.

Q: what percent is IE browser?

The answer: they see lots of IE coming into myspace.com.

MSFast: browser toolbar for IE.  Many people ask "Why did you pick IE?  Why talk about it at an open source conference?!"  Good point!

http://msfast.com  http://bit.ly/6d3Nft http://bit.ly/8WWnpT

Hey gang: do any other tools doo all this?

measures render time of page elements, validates page against sets of best practices.

What's MSFast: measures CPU and memory state of the browser...captures screenshots of rendered sections.

(btw, the guy didn't have a DVI-to-VGA dongle for his Mac laptop.  Sun to the rescue!  yay!)

Speaker says "MySpace is kinda new to open source."

Back!  MySpace's new open source perf analysis plug-in: MSFast.

Back in about 15 mins, folks.

Gonna go check out the session on MSFast (an open source web performance tracker)...gonna check it out with Glen Kriekenbeck, a Sun alum.

    Hadoop talk is over...waiting for the next talk.

They have VMware images you can download to run a cluster on your laptop

Free online training: http://bit.ly/50B6ss

Cloudera Hadoop and Big Data Blog: http://bit.ly/5Udcub

twitter feed: http://bit.ly/5bW0Rz

Resources to learn more about Hadoop: http://bit.ly/5Pc9gl

Univ. of Nebraska is such a recipient: 400TB Hadoop cluster to deal with the data for physicists.

"only" small fraction is interesting: 300MB/sec.  Delivered by CERN to remote data centers around the world.

Raw sensor data streaming off of Compact Muon Solenoid sensors in Switzerland, 320 terabits / sec.  That's a lotta data in a big hurry.

As long as the web page continues to say "NO", we're all okay.

You can go to this URL to find an up-to-the-minute answer (no kidding!) http://bit.ly/8YfXin

Question: "Does the energy from the LHC produce black holes?"  There's a web page that'll give you the answer.

Use Case 3: "Stalking the Wily Higgs Boson", the Large Hadron Collider, CERN (Switzerland)

(still talking about the TVA case study: "Capture, analyze, report")

40TB of data by 2010, growing to 100TB/year.  15TB already in archive.

Another use case: Tennessee Valley Authority (monitoring the electrical grid).

Rackspace was growing at 150GB per day; reached limits of MySQL on single machine.

(Apache solr is based on the Lucene search engine, which is written in Java)     http://bit.ly/4U3e1g

Uses Solr as a search interface.

case study slide: Rackspace log processing with Hadoop.

    Hive: provides SQL interface to the Hadoop cluster...turns queries into distributed Hadoop queries.

files broken into blocks & distributed across the system.  Replication guards against data failure.

talking about HDFS, the Hadoop Distributed File System.

http://hadoop.apache.org/ for more info about these components.

huh; interesting group of names.

Slide showing components in Hadoop: Pig, Chukwa, Hive, HBase, MapReduce, HDFS, ZooKeeper, Common, Avro.

open source..."Made famous by Yahoo!, Facebook, and other Web giants."  according to the speaker.

What is Hadoop?  MapReduce for computation and HDFS for storage.

Hey folks, I'm back. It's the Hadoop session at OSCON.

Back in 15 minutes, gang

Getting ready to go mobile on the exhibit floor; back in a few minutes, folks.

I'll be at this session in an hour: http://oreil.ly/6B8iAL

I'll be updating from my mobile phone here and there so stay with me, and talk back to me!

 Ah: looks like an afternoon break,     3:20PM PT to 4:30PM PT.  I'm going to wander the booths for a bit, see what I can see.

Concluding this session...going to go to the Hadoop session in a few minutes.

Talking about the dashboard more.  Comparing it to Sun's "Amber Road" storage server product analytics dashboard.

Comment from audience: "I roll my own web stack, so I'm suspicious of somebody saying their thing will solve all my problems."

...and it's a business question, no technical barriers that we've seen.  Want a specific ISV?  Talk to George Drapeau (your host).

A: yes, we're starting to see them.

Q: any ISVs certified their apps with your stack?

A (cont'd): to buy WebStack, turns out you buy the Glassfish portfolio and you get WebStack as part of it.

A: It's part of the larger portfolio, the Glassfish Portfolio.  WebStack is a subset of that portfolio.

Q: Glassfish app container is not part of this stack?

A: we don't make huge mods to Tomcat; it's almost as-is.

Another question: "What's the relnship b/w your web server and Apache Tomcat?"

Anybody have a pointer to documentation on this?  I'll share it with the questioner if so.

Question from the audience: "w/typical deployment, what's best practice for load-balancing for high availability?"

Oh man, they're doing a giveaway for an iPod Shuffle.  Too bad I'm not eligible.

About to do a demo (ooh, demos).

If you have questions you want me to ask the presenters, just let me know.

MLB.com: 90M hits/day.  That's a lotta baseball, people.

http://blogs.sun.com deploys on Sun Web Server: 2M hits/day.

world record performance on SPECweb benchmarks.

speaker is talking about Sun Web Server 7.0 overview.

Open Source for web server:     http://is.gd/1I3n3

Factoid: Sun Web Server was originally Netscape Enterprise Server, but now open sourced (BSD license).

1 billion minutes of streaming media & 90M views / day: MLB.com's traffic, on Sun's web server.

1 GB per minute: Web Server's access log per minute (wow).

5,170 secure e-commerce (JSP) requests per second (with think time)

232,000+: simultaneous HTTP connections on a Sun Fire T5520 server.

276K LOC: # of lines of code in Open Web Server.

Somebody guesses: "Minesweeper?"

Actually, speaker is asking "What do 276K LOC mean?"

Sun Web Server Trivia: 276K lines of code.

Just leave a comment here on G-snap!  Don't be shy, now.

Remember folks: I'll be here tomorrow as well, so look at the conference schedule online and tell me which sessions I should attend.

URL for this talk: http://is.gd/1I30y

"Web Stack scales to 10,000 users w/MySQL hosting 1 Million users and 1TB of data."

Waiting for the numbers.

CVR (the eng. manager for Sun's WebStack product) is talking about performance of Web Stack on Intel's Nehalem processors.

perf. improvements, Enterprise Manager (pretty graphs & charts, and analytics), multi-install on same system.

New features in WebStack 1.5 include:

Number of PHP issues found in past 18 months: 576 (yikes!).

The answer: 21.

Any guesses?

Opened with a pop quiz: "How many security problems were found in Apache in the last 18 months?"

Okay, done setting up; I'm here now.  Watching CVR talk about Sun's WebStack product.

    Ok

Have a session you want me to attend?  Look here: http://oreil.ly/7WzIov and tell me which sessions I should attend.

I am at the O'Reilly Open Source Conference (OSCON) in San Jose, California.  I'll be 'casting the sessions I attend Wed. & Thurs.

Have an opinion? Share your thoughts! Next time, try creating a Snapcast for your event! It's easy!

Welcome to G-SNAP!