https://deliprao.com/ Essays on AI research and product building. en-us https://deliprao.com/2024/09/a-catalogue-of-ai-research-idea-generators/ https://deliprao.com/2024/09/a-catalogue-of-ai-research-idea-generators/ Wed, 04 Sep 2024 10:08:45 +0000 I am offering a preliminary catalog of AI research idea generators distilled from at least a thousand AI research papers I have read, skimmed, or glanced at during my career. I have not seen this anywhere else. Each of these is a tried and tested formula/recipe for generating AI research ideas. https://deliprao.com/2023/08/publishing-tips-for-free-radicals-and-other-creatives/ https://deliprao.com/2023/08/publishing-tips-for-free-radicals-and-other-creatives/ Tue, 22 Aug 2023 04:26:51 +0000 Many folks interested in AI research may not have the luxuries of working at a top research lab or a tier-1 academic lab. Perhaps you are in a grad school with an advisor who is not meeting with you often (famous professor problem), or you are a researcher in a small school or startup without much “community” for meaningful feedback, or you are a lone warrior with no pedigree to show other than good hacking skills, and a couple of GPUs in your rig. If you identify with this class, have a strong interest in participating in science discourse, and wonder how to write a paper for fun, I am writing this essay for you. https://deliprao.com/2023/06/the-data-center-is-the-new-vc/ https://deliprao.com/2023/06/the-data-center-is-the-new-vc/ Thu, 29 Jun 2023 13:49:30 +0000 The recent Inflection AI fundraising news confirmed a hypothesis I had a while: for modern AI startups, the “data center is the new VC firm”. Why just rent out your silicon when you can have a nice slice of the equity? https://deliprao.com/2023/04/how-to-understand-the-post-llm-world/ https://deliprao.com/2023/04/how-to-understand-the-post-llm-world/ Fri, 21 Apr 2023 22:52:25 +0000 A mental model for builders and investors building with modern AI models. https://deliprao.com/2022/09/what-if-transformer-is-all-we-need/ https://deliprao.com/2022/09/what-if-transformer-is-all-we-need/ Wed, 14 Sep 2022 17:13:59 +0000 Imagine a future where Transformers become all that we need. What would that future look like? If you are a builder, a product person, or an investor, you might want to pay attention to this. https://deliprao.com/2022/08/what-is-ai-automation-and-what-it-isnt/ https://deliprao.com/2022/08/what-is-ai-automation-and-what-it-isnt/ Mon, 29 Aug 2022 23:58:46 +0000 AI automation is not a dualistic experience. One of the dangers of the hype over-attributing capabilities of a system is, we lose sight of the fact that automation is a continuum as opposed to a discrete state. In addition to stoking irrational fears about automation, this kind of thinking also throws out of the window any exciting partial-automation possibilities (and products) that lie on the spectrum. https://deliprao.com/2021/11/reputation-risk-and-personal-growth/ https://deliprao.com/2021/11/reputation-risk-and-personal-growth/ Fri, 12 Nov 2021 19:03:00 +0000 I have been exploring DeFi, and what’s now broadly called Web3, for a while now. It’s difficult to describe my impressions fully, but as an AI researcher, I can see a 2010 deep learning-like tech wave happening all over again, but in entirely unrelated technologies. https://deliprao.com/2021/08/discipline-is-overrated/ https://deliprao.com/2021/08/discipline-is-overrated/ Tue, 03 Aug 2021 22:35:36 +0000 I advise a few founders and one general product heuristic seems to surface over and over:   Any aspect of your work or life requiring “discipline” is usually a sign of a tooling gap or an automation gap. Many of these gaps are product/startup opportunities waiting to be taken. To bring the conversation closer to […] https://deliprao.com/2021/07/teach-dont-document/ https://deliprao.com/2021/07/teach-dont-document/ Mon, 12 Jul 2021 19:07:00 +0000 With Machine Learning increasingly looking like a software engineering discipline, and a new library coming out every other week, developers have little patience to spend months mastering terse documentation before doing something useful. How then do you capture the mind share of the talent who will go on to evangelize your precious framework or library in their workplaces? https://deliprao.com/2021/02/lessons-from-writing-a-million-words/ https://deliprao.com/2021/02/lessons-from-writing-a-million-words/ Thu, 11 Feb 2021 19:13:00 +0000 Where I share my “recent” writing experiment. https://deliprao.com/2020/08/gpt-3s-turk-gambit-ai-hype-safety/ https://deliprao.com/2020/08/gpt-3s-turk-gambit-ai-hype-safety/ Thu, 20 Aug 2020 23:09:35 +0000 Customers mislead into believing these hyped up capabilities could potentially endanger themselves and others due to misplaced trust. As AI models become easier to use (as GPT-3’s few-shot examples promise), folks building with AI models will increasingly not be AI experts who designed those models. https://deliprao.com/2020/03/unstoppable-ai-flywheels-and-the-making-of-the-new-goliaths/ https://deliprao.com/2020/03/unstoppable-ai-flywheels-and-the-making-of-the-new-goliaths/ Sun, 29 Mar 2020 19:16:00 +0000 AI creates engines for relentless optimization at all levels. Read the article to figure out how and its consequences to what you’re doing. https://deliprao.com/2019/12/the-twelve-truths-of-machine-learning-for-the-real-world/ https://deliprao.com/2019/12/the-twelve-truths-of-machine-learning-for-the-real-world/ Wed, 25 Dec 2019 19:29:28 +0000 Last month I gave an informal talk to an intimate gathering of friends with this title that I am putting down in words. This post is mainly for people who are using machine learning to build something as opposed to people who are working on machine learning for its own sake (god bless them). Although […] https://deliprao.com/2019/12/the-doers-and-the-clarion-callers/ https://deliprao.com/2019/12/the-doers-and-the-clarion-callers/ Mon, 02 Dec 2019 19:29:00 +0000 There is an unnecessary drama unfolding on Twitter on “the war” between connectionists and symbolists. This drama is absurd and perpetuated by people whose relevance exists only in the discussion of the “difference” and the “war.”