Techtalk

  The view provided by the lunar eclipse from Earth is familiar, but it is not the same as the view from space. Lucy, the asteroid probe led by the Southwest Research Institute (SwRI) that will launch in October 2021, has given us an idea of how it will look from there. Lucy was approximately 100 million kilometres (65 million miles) from Earth during the eclipse earlier this month, which occurred on the night of May 16 across most of the Americas. "While total lunar eclipses aren't that rare – they happen about once a year or so – you don't often get a chance to observe them from an entirely new angle," said planetary scientist Hal Levison of the University of Arizona. "When the team realized Lucy would have the opportunity to observe this lunar eclipse as part of the instrument calibration process, everyone was ecstatic." The spacecraft took 86 1-millisecond exposures with its high-resolution, black-and-white L'LORRI instrument in three hours. The imag...

In the real world, data is typically presented in a variety of formats. Images, for example, are frequently paired with tags and text explanations; the text may use images to better explain the main topic of the article. Different statistical characteristics distinguish different modalities.  Texts are typically represented as discrete word count vectors, whereas images are typically represented as pixel intensities or feature extractor outputs. Because different information resources have different statistical features, determining the link between different modalities is critical. Multimodal learning has emerged as a promising method for representing the combination of representations from various modalities. Text-to-image synthesis and image-text contrastive learning are two recent examples of multimodal learning. Imagen, a text-to-image diffusion model that combines, is introduced in a new Google Brain Research. Diffusion models with high fidelity In text-to-image synthesis, th...