Rapid advances inspired the world to reflect on 2023 as “the year of AI,” specifically generative AI (genAI), sparking renewed interest in AI strategies and experimentation. Although data teams build these models, infrastructure professionals must serve their needs. This is no easy task because requirements vary by AI use case, with some pushing the boundaries of what existing systems can do and what infrastructure professionals have experience in managing. GenAI has created enormous infrastructure demands for data storage and processing amid chip supply shortages. This report helps infrastructure professionals make key decisions on AI infrastructure (e.g., compute, network, storage).