GitHub user jolin1337 created a discussion: Proposal: Enable the possibility to store in memory video/images/raw-bytes through common.io xcom backend
**Proposal**: I suggest that we should be able to store in memory video/images/raw-bytes through common.io xcom backend. After opening a PR: https://github.com/apache/airflow/pull/61777 I realized that this might not be the implementation the community would do in the common.io provider as @Nataneljpwd pointed out. What data-types should be supported to store in this provider and what is the actual puprose of it? **Current behaviour**: We only support json serializable objects. And I could not find any previous discussions about supporting other serializatoin methods. **My optinion**: I think it is pretty convenient that it exists both as a fallback that we do not accidentally store big files in S3 but also as a reliable feature to standardize the bucket paths in s3 for all dags that are running in the airflow instance. **Suggestion**: I think the purest form of data we can store is raw bytes, and don't care about the contents. Although since json is already implemented and for the sake of not destroy backward compatibility we would support both JSON and raw bytes data. What are your takes on the topic? GitHub link: https://github.com/apache/airflow/discussions/61843 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
