Tag Archives: brainstorming

What’s next for the “Repeating Crumley” experiments?

I have all this growth rate data from the RC experiments. And Steve and I were trying to ascertain whether those results achieved what we wanted to achieve. It is clear that Crumley et al were wrong in 1950 about 99% D2O growth, the tobacco seeds will not grow in 99% D2O despite what they say. Otherwise their data set seems pretty repeatable with an obvious stagger between DI, 33% D2O, and 66% D2O.

But then the experiments seemed to evolve. I added deuterium depleted water to the mix and eventually added D2O/DDW mixtures as well. Some results are obvious (like 33% D2O in DDW is slower growing than pure DDW or even DI water), while others are more convoluted (Do seeds growing in 99.9% DDW grow any differently than seeds in DI water?).

Steve and I tried to analyze this today and the results are quite interesting. When looking purely at the germination rates (number of seeds that sprouted / number of seeds unsprouted) it is tough to make any conclusive claim outside of differences between D2O mixes. By this I mean there is no confidence in any evidence that may say that DI seeds grow faster than DDW seeds.

We also looked at the value of the germination rate. In each sample there is some number of seeds that sprout and some number of seeds that never sprout. In some trials the number of seeds the don’t sprout in DDW are lower than those in the DI samples. But in other trials the reverse is true. So we don’t think that there is anything reliable in this analysis (for now). But what about between the pure and the D2O mixes?

In conversation, I mentioned that the germination rates don’t reveal all that much about the system. It’s kind of black and white. The seeds either sprout or they don’t and we are kinda just looking at the distribution of sprouting over time (does that make sense?). But to me the growth rates of the seeds are very telling. By day 10 all the seeds that will sprout have and no more information can be gained, but the lengths at this time are all very different and remain that way over time.

So we set up an experiment.

I showed Steve the slideshows that I setup from RC4, and kept them blind. Steve looked through and wrote down his thoughts and then I showed him which images belonged to which sample. Not only was it obvious what each sample was (via guessing), but it also appeared that the growth rates after germination were very different.

For part 2 of the experiment I showed Steve pictures (blinded) from Day 11 and Day 4 of the last batch of experiments (RC5). He wrote down notes on each image and then guessed which image belonged to which sample. It was clear again that there were differences between the water mixture sets (D2O in DI/DDW). There were also some differences between the DI and DDW sets but these were less obvious, and also kinda surprising (1% D2O in DDW had longer growth than DI water seeds).

The gist of the experiments is that there is way more than meets the eye, but right now I/we have no way to best measure these differences. The next step would be to study small concentrations of D2O around the range of natural water concentrations, but can those images reveal anything? Is there more to the germination rate stuff than what we’re seeing? How can I improve my data collection techniques? Would more time points be helpful?

Right now my mind is kinda blown from thinking about how best to proceed so if you have anything to say then say it below and I’ll join after I get a bit of recharge. In the meantime I’m going to make some time-lapses of the latest set of images and we’ll try the blind again with those “movies” tomorrow.

Project Planning Open Thread

I spoke with Alex about the future of our experiments. We are going to brainstorm ideas and ellaborate on others here and anyone and everyone is invited to join in. When Alex uploads her notes from the discussion I’ll link/post that here as well. See ya soon…

Update: Here is the link from Alex:

Crowdfunding for science?

Anyone know of any successful crowdfunding ventures for the scientific community? I’ll be looking into this avenue to determine how viable an option this is for scientists. I would love to know more about the idea and the execution. Hit me up in the comments.

Ideas about ONS spawned from #scio12 conversations

…that I plan to expand upon in future posts.

Talking with everyone about open science face-to-face is super exciting. It’s one thing to hear all the activity online, but to see that others are as excited about this stuff as I am is sheerly amazing. And from this excitement many ideas have come to surface. Not all of them are hashed out, but they are all worth mentioning and hopefully expanding upon. Here are some things that have been mentioned:

  • Making ONS viable for the common scientist is a pretty big hurdle. Not only is it already challenging to get PI’s to allow young scientists to go open access, but it is overwhelming to get into with all the options available. The viability of ONS is extremely important to me and I think WordPress is going to be key.
  • An overlooked key aspect of ONS is the fact that every part of a project is traceable. From the data you can discover the methods to how the data was acquired and analyzed. How many scientists look at a figure and wonder how a researcher reaches those conclusions? I’m guessing a lot, and ONS removes the question marks.
  • Signal to noise… posting all data and methods creates a lot of information in one location. How are others supposed to find the meaningful results in the sea of data? This is one of the reasons that I wrote the post about effective design and navigation in a notebook. If users can’t find the information they need immediately, then the information is almost useless. Curating and organizing this data takes time, but in the end is worth it and makes you a much better scientist!
  • I think citizen science can be incorporated into ONS. Why should notebooks contain only science done in labs? Why can’t notebooks be used to engage not just the scientific community, but also the local or global community?
  • Engaging the scientific community, in general, is a major obstacle. Why do people frequently comment on blogs and websites, but scientists refuse to leave comments on peer reviewed papers or fact based web pages? What is the barrier and how can it be removed?
  • Mark Hahnel (of FigShare fame) suggested a site that lists the success of ONS. onssuccess.com anyone?
  • And as an umbrella to that, why isn’t there a site that is a repository for all the open notebooks in the world. A live feed of posts from these notebooks seems very feasible and could be a way to organize the movement of open notebook science. opennotebook.org could be a thing…
  • Curating notebooks is a major concern to me. Scientific data is obviously important, and the internet is a very dynamic place. Trusting that resources will be around long term is a concern and even more so for the self-hosted guys (like myself). Can there be a place that guarantees the longevity of notebooks? Talking with Brian Glanz of Open Science Foundation has revealed that business seem to have more sway in universities than understood, because otherwise why wouldn’t libraries take up the cause?

I’m sure there is a lot that I’m forgetting, but these were the biggest ideas that I can think of.  Some of this stuff is in need of a solution. This will come in time, but I hope to be part of the solution.

In addition to that, the spirit of the conference has given me two very interesting ideas:

  1. An unclass about open notebook science. The idea of the unconference is to spark discussion amongst peers and I think in the context of ONS this can be done in a class. Right now there is no wrong way to do an open notebook, so the first unclass will have to be a discussion about what are the core values of ONS and open science in general. The students would then be given complete freedom to choose the notebooking medium that they want, and classes would engage discussion about what are the benefits and downfalls of their chosen medium. Discussions would then evolve into problems with ONS and successes of it as well. This could be really awesome since there would be a mini community of notebookers and they could all learn from each other. It would be a small scale case study of the proliferation of notebooks! I think I’ve convinced myself to do this now!
  2. A class or two on effective communication in science. A lot of this notebook is geared toward inclusive information, and by that I mean I always explain things as simply as possible so that anyone can understand what I mean (or at least I try to). I would like to talk about principles of design and writing that I’ve learned over the years from being a graphic designer and a blogger and apply them to the scientific setting. Teaching this to the next level of scientists will ensure that the future of science is in good hands. In much the same way that journals brought a change in scientific culture over 400 years ago, these principles can take science to a whole new level. Everyone here at ScienceOnline gets it, why doesn’t the rest of the scientific community?

As always feel free to leave your thought below. I completely encourage criticism of any sort!

Planning For #Scio12: Open Notebook Science Discussion

This is the week of the greatest conference in the world: Science Online 2012! I’ve never been but I’ve heard amazing things about it and I can’t wait to go, hence my personal declaration. Not only will I be going, but I’m also co-hosting the Open Notebook Science session with Jean-Claude Bradley. The session is on Thursday at 1:30pm.

Since this is my first time attending Scio12 (as it is lovingly referred to on twitter) and unconferences in general (are there other unconferences?) I have a lot to adjust to. Another issue is that my session is on the first day so I will only be able to get a feel of the conference very briefly before I’m up.

But I’m not worried. From what I’ve been told I’m just supposed to lead a discussion. And I’m excellent at doing that. I really don’t enjoy the sound of my voice for an hour and I much prefer to engage my audience. In this format the audience isn’t really an audience, but rather a collection of peers who have valuable information to share.

And share we will!

So for the next three days I am going to be planning what I would like to share with the audience and what I hope to learn from those in the session. I’ll make a mindmap that will be live updated and from time to time I’ll ask some pre-questions to try and build some steam for the session.

Currently here is the session plan:

We will discuss the semantic representation of Open Lab Notebooks and automated discovery by social mapping of ONS content. An example of merging ONS datasets with “Dark Open Science Contributors” – companies and government agencies that will donate large amounts of data to the public domain – if they are asked – will be presented. (e.g.Alfa Aesar and EPA donate Open Melting Point data ). We will also discuss the variety of electronic platforms for ONS and how to apply them in undergraduate science lab courses.

This plan was made with JC Bradley and Steve Koch, but Koch won’t be able to attend and I’m filling in.

Personally I’d like to discuss how to make ONS both viable for most scientists, and how to engage scientists to participate in ONS. Let’s face it, most people read and contribute to blogs daily. But open notebooks in my experience receive very little attention. I’ve had posts record hundreds of hits, but those same posts have 1 or 2 comments.

How do we get others to engage in the conversation? How do we get others to start their own notebooks? How do we prove that ONS isn’t just some fad, but is required for long-term scientific health?

And how do I get people going to Scio12 to comment on this post to start the conversation for the session before we even step foot in the room?

Project Outline for DDW Effects on Microorgansims

Another page for project outlining that will change over time.

UPDATE: I changed the embed code so the map has live update capabilities.

DDW Effects on Seeds Project Planning

Steve and I have decided to try and publish the results of this study. I’ve made a mindmap that will allow us to coordinate the planning of the paper and upcoming experiments to include in the paper. This page will be updated frequently so check here often.

Preplanning in Open Notebooks

Part of the change in notebook philosophy will come in the form of engaging the scientific community. I’m very receptive to feedback, and I want to provide visitors a chance to engage earlier in the scientific process. So from now on (following a former ONS behavior of mine) I will publish my experimental planning before execution.

Usually I just have the ideas jumbled in my head and I write thoughts down on a piece of paper as they come (so I don’t forget). When I used to notebook on OWW, I would preplan experimental protocols and receive some feedback from Koch before execution and it greatly helped my efficiency in lab.

With these experiments I’ve just been kinda going with the flow, but now I need to concentrate my efforts, especially for Alex’s sake. Also it is just plain, good habit. And finally visitors can contribute thoughts to an experiment before the experiment gets underway. This is especially beneficial for ONS, and something that would be excellent to show people who are skeptical of ONS.

Not only should notebook viewers have access to data, methods, results, and ideas, but they should also have access to the plan as well. Instead of wondering why someone took a certain approach, you can actually see the thinking behind a method. To me that is just as useful as any of the other open notebook principles.

On top of that, I know that at some point in the future I’m going to want to know why I did something and having access to my own thoughts, not just in execution, has been useful in the past and will be useful once again. Plus like they say, you can never be too careful, and publishing my plans prior to setup is another way to ensure that my setup is executed without a hitch.

From here on out, all preplanning activities will go under the “setup” tag, which usually just houses the official setups of an experiment after the setup is performed. Now there will also be pre-setup posts and maybe one day there will be phil-setup posts (phil- is a prefix Larry Herskowitz and I invented to describe things that are happening in the present, as opposed to pre- (before) and post- (after)).

Project Planning, Ideas, etc. Thread

This page will be used for brainstorming in any sort of way. If you are just visiting feel free to join the conversation. Simply state a question, comment, idea, etc in the comments and you’re in! This page will not be used for all brainstorming sessions, merely this one. I’ll do other comment threads in the future for this very reason (if it works well, which I’m sure it will because of the nested commenting system and possibility to tweet/facebook comments.

Have at it!