rejetto forum

Software => HFS ~ HTTP File Server => Topic started by: rejetto on December 14, 2006, 08:54:33 PM

Title: chinese? japanese? russian?
Post by: rejetto on December 14, 2006, 08:54:33 PM
hi!

i know many people, mostly eastern, using non-latin characters have problems using HFS.
this is mostly because the default template used by HFS is designed for latin characters.

It is time for a change!

I'm trying to make a better support for unicode.
I need you to test this version, but using the default template.
If you really want to use a customized template ensure this line is present:
Code: [Select]
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />

but please, consider a customized template may have unknown errors itself.
If you report an error, tell me which template are you using, and please furnish also screenshots.

Download and test! (http://www.rejetto.com/temp/hfs077.exe)


there is no full unicode support yet. if you want to use chinese symbols in an english system, this is not supported. anyway, most people use chinese symbols on chinese systems, and that's not a problem.
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 14, 2006, 09:21:34 PM
forgot the what's new list for this build

+ support for UTF-8 templates
+ Menu -> Upload -> "How to?"
- HFS was not more working with "Persistent connections" disabled
- "last update check" saves inside HFS folder
Title: Re: chinese? japanese? russian?
Post by: Bers on December 14, 2006, 11:30:52 PM
Russain language not need special features

need only one thing
 
Code: [Select]
<meta http-equiv="content-type" content="text/html; charset=win1251">
work perfectly
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 15, 2006, 12:18:36 AM
yes, that's what all languages need.
but you are talking about modifications.
i want HFS to be good with no modification, ready to go!
Title: Re: chinese? japanese? russian?
Post by: BruteHost on December 15, 2006, 08:19:13 AM
Nice work :)

Here we go.

This version was installed, none of option has been change.
I added two folders that are named in russian, real and virtual.

The very first page is ok.
Good things are marked green color.

After entering to one of the folders
title of the page, filepath... are in win1251 not utf-8
Marked red.

See attached screenshots.




[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 15, 2006, 03:14:09 PM
ok, i fixed that thing
here is the new build
www.rejetto.com/temp/hfs070.exe
Title: Re: chinese? japanese? russian?
Post by: JO on December 17, 2006, 01:18:48 PM
Hello.

I am Japanese.
When HFS is used under a Japanese environment, it does so.

<meta http-equiv="content-type" content="text/html; charset=shift-jis" />

It is normally displayed by this.

However, there is a problem, too.

When a Japanese file is downloaded for realfolder after it sorts it, ..the error... (404)

After it normally sorts it, it is possible to download it for virtualfolder.

Can this problem be evaded?
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 17, 2006, 04:26:20 PM
NO!
you don't have to modify the <meta> thing.
Just ensure you are using the default template, or if you don't, use this
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
Title: Re: chinese? japanese? russian?
Post by: JO on December 17, 2006, 06:19:57 PM
 :'(
UTF-8 doesn't function normally.

When using it under a Japanese environment
When the default template is used, all Japanese parts are garbled.

It is a result of the verification with two PC.
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 17, 2006, 07:00:49 PM
ok... doesn't work, but i would like to solve the problem also :)
i need some information, can you furnish screenshots of the problem?
when you reply on this forum, clicking on "additional options" you can attach files.
i need a screenshots of the browser, and one of the HFS main window. can you?
Title: Re: chinese? japanese? russian?
Post by: JO on December 18, 2006, 02:33:13 AM
Hello.

The reason for the garble turned out.
The default template is used.
Only when HFS is seen from a browser, the garble's happening :.

Encode is UTF-8.
When encode is shift_JIS, it is seen normally.

However, in either case of UTF-8 and shift_JIS
When the folder with the file that gives a Japanese name is sorted, it is not possible to
download it. (404)

When it is made a virtual folder, this is not generated.
This is not generated for the file name of English and the figure.

Why do you understand?

Postscript

There is a volunteer who is making it to Japanese by using the source file. Will you become a language file format HFS?
(http://)
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 18, 2006, 02:35:45 AM
can you furnish screenshots?
Title: Re: chinese? japanese? russian?
Post by: JO on December 18, 2006, 02:37:55 AM
I'm sorry.

The photograph had been forgotten.

The main body of HFS side is normally displayed.


[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 18, 2006, 02:44:30 AM
can you furnish a screenshot of the HFS main window?
Title: Re: chinese? japanese? russian?
Post by: JO on December 18, 2006, 03:06:33 AM
OK.

[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 18, 2006, 03:13:20 AM
Thank you. Sadly, i'm not understanding this problem.
Can we chat on ICQ/MSN/IRC so i can try to investigate further?
You find my contacts here on the left.
Title: Re: chinese? japanese? russian?
Post by: JO on December 18, 2006, 03:15:04 AM
About the matter of sorting

The address before it sorts it

http://192.168.1.2/%81y%96%9F%89%E6%97p%87%40%81z/(C70)%20(%93%AF%90l%8E%8F)%20[%82%D3%82%A5%82%B7%82%BD%81B]%20%91%E62%8E%9FX%94h%20(%83X%83p%83%8D%83%7B)/%91%E62%8E%9FX%94h_01.jpg

It is normal. It is displayed.



The address after it sorts it

http://192.168.1.2/%E3%80%90%E6%BC%AB%E7%94%BB%E7%94%A8%E2%91%A0%E3%80%91/(C70)%20(%E5%90%8C%E4%BA%BA%E8%AA%8C)%20[%E3%81%B5%E3%81%87%E3%81%99%E3%81%9F%E3%80%82]%20%E7%AC%AC2%E6%AC%A1X%E6%B4%BE%20(%E3%82%B9%E3%83%91%E3%83%AD%E3%83%9C)/%91%E62%8E%9FX%94h_01.jpg

It is abnormal. It is not displayed.
404 - Not found

It is the same file. Japanese is filed, and it is not good.
Title: Re: chinese? japanese? russian?
Post by: JO on December 18, 2006, 03:21:16 AM
I'm sorry.

I cannot speak English.
It is not possible to chat with you.
It is very sad.


There is a volunteer who is making it to Japanese.
If it is him, it is difficult ・・・・・ that might understand and to come
in contact.

Let's tell a story on the bulletin board aiming at the problem solving.
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 18, 2006, 03:24:30 AM
Ok. Anyway, you may find a friend who is interested in this japanese compatibility problem, and would like to help.

Can you try using Firefox and see if the problem is the same or different?
Title: Re: chinese? japanese? russian?
Post by: JO on December 18, 2006, 05:07:35 AM
Yes

With three windowsXPPC
IE and Firefox were tried.

The result is the same.

When encode is UTF-8, it garbles.

Shift_JIS is chosen when making it to Auto Select.

Naturally, it is correctly displayed.

As for UTF-8 of HFS2.1c build72, it is not interchangeability Japanese.

All problems can be cleared only by changing the template into shift_JIS.

With this, is it useless?


The talk changes.
Can you do making the file of the language of the main body?
Title: Re: chinese? japanese? russian?
Post by: JO on December 19, 2006, 03:14:08 AM
Hello.

It is important information on the matter of UTF-8.



Isn't the output of the template UTF-8?

The template written with UTF-8
When the import exporting and preserving it
It is preserved with SHIFT-JIS, and the character outside SHIFT-JIS
disappears.



VFS is processed with SHIFT-JIS.

For instance, it garbles when Korean is made a file name, and it
registers.
VFS seems by UTF-8 to uncorrespond.
It is processed with depending SHIFT-JIS.

Reason
When [ 日本語 ] (Japanese Chinese character) is registered, it is
processed by [ %93%FA%96%7B%8C%EA ].
This is a method of processing SHIFT-JIS.

If it is a method of processing UTF-8
[ %E6%97%A5%E6%9C%AC%E8%AA%9E ]
It is necessary to become it so.

Title: Re: chinese? japanese? russian?
Post by: JO on December 19, 2006, 03:35:51 AM
Please look.


[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: maverick on December 19, 2006, 04:44:54 AM
JO

I was reading through this thread and I'm not sure that I understand your problem correctly.  I know it has something to do with encoding.

In your HFS template if you make the following change:

From:
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />

To:
<meta http-equiv="content-type" content="text/html; charset=Shift-JIS" />

1. Does everything look and work ok with that change?
2. Do virtual folders show up correctly?
3. Do real folders show up correctly?
4. What do you have your browser encoding set at?
Title: Re: chinese? japanese? russian?
Post by: JO on December 19, 2006, 05:51:11 AM
Hello.

I had changed to SHIFT-JIS since before.

Because it is normally displayed if it is SHIFT-JIS.

The encode of a browser becomes SHIFT-JIS.

It doesn't garble.

However, it interprets it with UTF-8 in the main body of HFS.

The problem occurs when a Japanese file is sorted though the reason
is uncertain.
It is the same also in UTF-8 and SHIFT-JIS.

The link cuts when a Japanese file is sorted when the folder hierarchy is 2
pieces or more.

This problem : only for a real folder.
It doesn't happen for a virtual folder.


I think. When you can solve the problem if all the input outputs are fixed to UTF-8.
Title: Re: chinese? japanese? russian?
Post by: maverick on December 19, 2006, 06:10:27 AM
The link cuts when a Japanese file is sorted when the folder hierarchy is 2
pieces or more.

By 2 pieces or more - does this mean 2 or more sub-directories?  If so, does it work correctly with NO sub-directories?

Quote
This problem : only for a real folder.
It doesn't happen for a virtual folder.

If the problem is only with real folders, that means you don't have problems if you use only virtual folders.  Right? 

rejetto will probably read this thread.  He might have a solution.
Title: Re: chinese? japanese? russian?
Post by: JO on December 19, 2006, 06:33:13 AM
It explains in detail.

For instance,
[ English name 1 ]----[ English name 2 ]-|
                                                       |---- English name 3.txt
                                                       |---- Japanese name 3. txt

In this case, it is possible to download it by sorting it without trouble.

However,
[ japanese name 1 ]----[ Japanese name 2 ]-|
                                                             |---- English name 3.txt
                                                             |---- Japanese name 3.txt

In this case, Japanese name. Txt cannot be downloaded when sorting it.

In both cases, English name 3.txt can be downloaded by sorting it without trouble.

Supplementation ・・・
[ **** ] = folder
Title: Re: chinese? japanese? russian?
Post by: JO on December 19, 2006, 06:58:29 AM
I noticed an important thing.

However, there is no time.

It presents it being put the report together in several hours.

Title: Re: chinese? japanese? russian?
Post by: jkb on December 19, 2006, 03:33:05 PM
Hi, please try this one, i found lots can't display correct

http://download.twftp.org/ftp_utf8_test.rar
(file from http://vbb.twftp.org/index.php )

[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: JO on December 19, 2006, 03:50:50 PM
Hello.

The thing discovered about the sorting problem is told.

For Japanese version windowsXP

As for the Japanese name file, the address on a browser is displayed with SHIFT-
JIS.

However, when sorting ・・・

The Japanese name file is displayed with UTF-8 in the address on a browser.

I think that this is a cause.
Is it a kind of the bug?


[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 21, 2006, 04:57:08 AM
The link and the displayed file name are two different problems.
What i'm trying to fix with this new version is the displayed file name.
The link generation is untouched from previous version.
I see "??" also in the "shit-jis" screenshot. Isn't it a little strange? Is there a way you know to get it displayed correctly?
Title: Re: chinese? japanese? russian?
Post by: JO on December 21, 2006, 05:14:38 AM
I'm sorry.

If the browser encode is changed into SHIFT-JIS, it looks normal.

Especially, the screen shot was taken with UTF-8 garbled.


Postscript

The volunteer who was making a Japanese version made the version that was able to
evade the UTF-8 problem.
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 21, 2006, 05:17:21 AM
who is this volunteer?
Title: Re: chinese? japanese? russian?
Post by: JO on December 21, 2006, 05:29:13 AM
HFS2.1c Build73

The problem of UTF-8 has been improved.
A Japanese environment looks normal.


However, the problem of sorting is not improved.

The screen shot that puts detailed information is given later.

I do not have time now.


>>About the volunteer

He : for the reason that it is not possible to support it.

Especially, it doesn't come to this forum.

However, he is a terrible person in your.. externals.

Title: Re: chinese? japanese? russian?
Post by: jkb on December 21, 2006, 02:00:12 PM
on HFS build 073, it display this, the format is crash...



[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 23, 2006, 04:13:24 PM
Please test Build #074
http://www.rejetto.com/forum/index.php?topic=3791.msg1020427#msg1020427

i didn't work yet on the "format" problem reported just above, but it may have been accidentally fixed. ;)
Title: Re: chinese? japanese? russian?
Post by: jkb on December 23, 2006, 04:18:43 PM
Please test Build #074
http://www.rejetto.com/forum/index.php?topic=3791.msg1020427#msg1020427

i didn't work yet on the "format" problem reported just above, but it may have been accidentally fixed. ;)

the problem still the same
http://59.127.195.179:8888/
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 23, 2006, 04:24:34 PM
the fact you are getting those %build-time% and %comment% in the final page makes me think you are doing something wrong.

1. are you sure you are using build #074 ? (if you are unsure, please furnish a screenshot)
2. are you sure you are using default template?
Title: Re: chinese? japanese? russian?
Post by: jkb on December 23, 2006, 04:28:52 PM
the fact you are getting those %build-time% and %comment% in the final page makes me think you are doing something wrong.

1. are you sure you are using build #074 ? (if you are unsure, please furnish a screenshot)
2. are you sure you are using default template?

yes, i use build 074 and default template just download from here.


[attachment deleted by admin]
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 23, 2006, 04:38:04 PM
there is something very bad happening there.  :o
1. don't you see a "Customized template" in the status bar, on the bottom of the window?
2. did you try to reboot?
3. can you tell a previous version perfectly working for you?
Title: Re: chinese? japanese? russian?
Post by: jkb on December 23, 2006, 04:47:43 PM
there is something very bad happening there.  :o
1. don't you see a "Customized template" in the status bar, on the bottom of the window?
2. did you try to reboot?
3. can you tell a previous version perfectly working for you?

build 072's format is correct(but display wrong, can't display correct chinese char.), 073, 074 has problem
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 23, 2006, 04:55:31 PM
can you please re-test www.rejetto.com/temp/hfs072.exe
and tell me if it works well also now?
Title: Re: chinese? japanese? russian?
Post by: jkb on December 23, 2006, 05:00:10 PM
can you please re-test www.rejetto.com/temp/hfs072.exe
and tell me if it works well also now?

format is correct, chinese char. can't display correct

http://59.127.195.179:8888/
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 23, 2006, 05:09:25 PM
i won't be home for a while.
can you contact me on an instant messanger?
you find me addresses here www.rejetto.com/me/
Title: Re: chinese? japanese? russian?
Post by: Garphy on December 23, 2006, 05:28:37 PM
can you please re-test www.rejetto.com/temp/hfs072.exe
and tell me if it works well also now?

format is correct, chinese char. can't display correct

http://59.127.195.179:8888/

把模版里的
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
改成
<meta http-equiv="content-type" content="text/html;charset=gbk">
试试看


我这边一切正常,074的用UTF-8可以直接显示,但是074的默认模版存在问题...

不行就用我的汉化版看看:
http://bbs.78820.com/viewthread.php?tid=4716
Title: Re: chinese? japanese? russian?
Post by: jkb on December 23, 2006, 05:36:03 PM
Quote
把模版里的
<meta http-equiv="content-type" content="text/html; charset=UTF-8" />
改成
<meta http-equiv="content-type" content="text/html;charset=gbk">
试试看

我这边一切正常,074的用UTF-8可以直接显示...

不行就用我的汉化版看看:
http://bbs.78820.com/viewthread.php?tid=4716

073 074可以不用改charset就可以顯示中文字了, 但版面格式會亂掉
072以前的版面格式正確, 但不能直接顯示中文, 要改charset=big5
Title: Re: chinese? japanese? russian?
Post by: Garphy on December 23, 2006, 05:38:48 PM
074的用旧的模版,版面就ok,
074默认模版生成的页面里会离奇出现一个%,破坏代码完整性...

074 with old template is ok

Title: Re: chinese? japanese? russian?
Post by: jkb on December 23, 2006, 05:48:42 PM
074的用旧的模版,版面就ok,
074默认模版生成的页面里会离奇出现一个%,破坏代码完整性...

074 with old template is ok



no...i use build 074 with 072 template, also format incorrect
Title: Re: chinese? japanese? russian?
Post by: Garphy on December 24, 2006, 05:58:41 AM
no...i use build 074 with 072 template, also format incorrect

my 071 template (edited) is ok

finally I know why...
还是字符集问题,改成gbk就正常了...

still charset problem...

modify UTF-8 to gbk  ,display errors disappear...

this error also exists in 075
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 25, 2006, 05:41:34 AM
new attempt to make it work :)
http://www.rejetto.com/forum/index.php?topic=3791.msg1020495#msg1020495
Title: Re: chinese? japanese? russian?
Post by: Garphy on December 25, 2006, 03:56:34 PM
still problem
http://www.rejetto.com/forum/index.php?topic=4043.0
Title: Re: chinese? japanese? russian?
Post by: rejetto on December 31, 2006, 03:54:29 PM
ok, thanks to WYF, we tested for 2 hours and got WHERE is the problem.
it is when the number of multibyte characters has an ODD total.
let say, since most chinese characters i saw are 3 bytes in UTF8, if you have a filename with single character, then you'll have 3 bytes, and error. instead 2 symbols, 6 bytes, no error. and so on.

i will investigate further to find also a fix to this.
Title: Re: chinese? japanese? russian?
Post by: angus on January 01, 2007, 08:24:46 AM
although the template support utf-8..
but the file name is not utf-8..
finally, it has problems of html display

testing latest version 2.1c
Title: Re: chinese? japanese? russian?
Post by: rejetto on January 02, 2007, 04:38:02 PM
ok, it took many hours, but now we have some news
www.rejetto.com/temp/hfs077.exe

let me know
Title: Re: chinese? japanese? russian?
Post by: jkb on January 03, 2007, 03:00:10 PM
ok, it took many hours, but now we have some news
www.rejetto.com/temp/hfs077.exe

let me know

some Chinese words still can't display correct, like 喆  堃  煊....
It display by "?"
Do other one has the same problem?
If it's a folder, can't access.
If it's a file, can't open

test file : http://59.127.195.179/ftp_utf8_test1.rar
Title: Re: chinese? japanese? russian?
Post by: rejetto on January 03, 2007, 03:16:23 PM
please someone (chinese) test the problem above reported by jkb!
Title: Re: chinese? japanese? russian?
Post by: 琥珀 on January 05, 2007, 12:21:22 PM
If HFS is Unicode (UTF-16) based for Windows 2000~Vista, and Unicode (UTF-8) based for web page handling, many problems will be solved.

First of all, HFS should drop Windows 95/98/ME systems (unless using MSLU), and to be fully Unicode (UTF-16) enabled for Windows 2000 and later operating systems.
Title: Re: chinese? japanese? russian?
Post by: rejetto on January 06, 2007, 03:45:01 PM
yes, i know, but it requires some work to do it.
the next planned step for unicode compatibility is filenames on disk. they are not supported yet.

in the while i just fixed a unicode problem with template editor
http://www.rejetto.com/forum/index.php?topic=3791.msg1020750#msg1020750
Title: Re: chinese? japanese? russian?
Post by: 琥珀 on January 07, 2007, 01:53:49 PM
On Big5 (CP950) systems, it must treat these as Unicode: 喆、堃、煊. It can't manipulate it on Non-Unicode programs. Unicode is the only cure.

On GBK (CP936) systems, it absolutely has no problem, since CP936 includes 喆、堃、煊.
Title: Re: chinese? japanese? russian?
Post by: rejetto on January 07, 2007, 01:57:00 PM
ah, then this is the problem.
that symbol is not part of BIG5, thus also filenames on disk with that symbol are actually unicode, and thus not supported by HFS atm.
this is the solution of the enigma.
it will be fixed when unicode files on disk will be supported. (already in to-do-list)
don't ask when  ::)
Title: Re: chinese? japanese? russian?
Post by: chenyu on January 02, 2008, 09:04:26 AM
I'm a chinese


<meta http-equiv="content-type" content="text/html; charset=gb2312" />

it is very good !