The red X icon that shows up next to your files on Windows is actually a OneDrive warning sign. It indicates a syncing error, ...

You can identify an offline file by the overlay that shows an “x” character in the lower-left corner of the file icon. Instead, an “normal file” icon may display the offline files.