StreamWriter结合UTF-8编码使用不当，会造成BOM（Byte Order Mark ）问题生成乱码（转载）

问：

---

 

I was using HttpWebRequest to try a rest api in ASP.NET Core MVC.
Here is my HttpWebRequest client code:

HttpWebRequest req = (HttpWebRequest)WebRequest.Create("http://localhost:55161/Home/Testing");

string data;
HttpWebResponse resp = (HttpWebResponse)req.GetResponse();
using (StreamReader reader = new StreamReader(resp.GetResponseStream(), System.Text.Encoding.UTF8))
{
    data = reader.ReadToEnd();
}

If I used StreamWriter to write a message to Response.Body in an ASP.NET Core controller, everything is fine:

using (var streamWriter = new StreamWriter(Response.Body, System.Text.Encoding.UTF8))
{
    streamWriter.Write("hello");
    streamWriter.Flush();
}

But if I used Response.Body.Write embedded in a StreamWriter block to write the same message, there will be a weird 65279 character in the end of the string "hello" when I got it from my client code.

using (var streamWriter = new StreamWriter(Response.Body, System.Text.Encoding.UTF8))
{
    byte[] data = System.Text.Encoding.UTF8.GetBytes("hello");
    Response.Body.Write(data, 0, data.Length);
}

I want to know if this is a bug or any mechanism caused this problem?
I didn't use UseBrowserLink in startup and my ASP.NET Core version is 2.1

 

 

答：

---

there will be a weird 65279 character in the end of the string "hello" when I got it from my client code

You mean something like this?

hello

This is expected based on the code you provided. Why are you wrapping the stream in a StreamWriter, then writing to the stream directly?

The StreamWriter has a buffer that it will flush to the output when you close it. This will cause a lot of problems if you've been writing to the stream directly. Specifically, what's happening here is this:

1. You wrap the Stream in the StreamWriter
2. You write hello directly to the stream
3. The StreamWriter is closed, so it flushes it's (empty) buffer.
4. Since you are using the Encoding.UTF8 encoding, the StreamWriter writes a UTF-8 Byte Order Mark (the sequence 0xEF 0xBB 0xBF which appears as  unless it's at the very beginning of the stream) to the stream. Since you've already written hello, this appears after your hello, causing the rendering glitch above.

 

因此我们可以看到，在使用StreamWriter的时候，千万不要又用代码直接往StreamWriter底层的Stream对象（本例中是Response.Body）写入数据，因为这很有可能会导致StreamWriter错误地将UTF-8编码的BOM（Byte Order Mark）加到了你写入数据的后面，而UTF-8编码的BOM（Byte Order Mark）只能够出现在一个Stream的最开头才能被正确地识别，否则会被识别为乱码，如同本例中的hello一样。

 

 

原文链接