aboutsummaryrefslogtreecommitdiffstats
path: root/enc
Commit message (Collapse)AuthorAgeFilesLines
* * transcode.c (transcode_loop): constified.nobu2008-07-141-8/+10
| | | | | | | | | | | | * transcode.c (str_transcode): rb_str_set_len() sets a delimiter. * transcode_data.h (rb_transcoder): constified preprocessor and postprocessor input. * enc/trans/japanese.c: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@18066 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/shift_jis.c (code_is_ctype): HALF WIDTH KATAKANA isnaruse2008-07-011-1/+1
| | | | | | a character. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17774 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* forgot to commitshyouhei2008-07-0128-55/+55
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17773 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/make_encdb.h: always add ';' at the end of line.usa2008-07-011-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17771 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/ascii.c: ISO C does not allow extra ';' outside of ashyouhei2008-07-013-50/+50
| | | | | | | | | | | | function * enc/us_ascii.c: ditto. * enc/utf_8.c: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17768 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_jp.c (property_name_to_ctype): core dumped when sizeof(int)mame2008-06-173-6/+7
| | | | | | | | | | | differs from sizeof(long). * enc/shift_jis.c (property_name_to_ctype): ditto. * enc/unicode.c (onigenc_unicode_property_name_to_ctype): ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17381 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/depend (clean): remove build directories.nobu2008-06-091-0/+4
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17060 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * lib/mkmf.rb (configuration): set flags.nobu2008-06-091-0/+4
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@17058 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/iso_8859_5.c: Large omicron should lowercase to small omicron.mame2008-06-021-1/+1
| | | | | | | | | | | | | | | * test/ruby/test_big5.rb, test/ruby/test_cp949.rb, test/ruby/test_euc_jp.rb, test/ruby/test_euc_kr.rb, test/ruby/test_euc_tw.rb, test/ruby/test_gb18030.rb, test/ruby/test_gbk.rb, test/ruby/test_iso_8859.rb, test/ruby/test_koi8.rb, test/ruby/test_shift_jis.rb, test/ruby/test_windows_1251.rb: new tests for encoding. * test/ruby/test_utf16.rb, test/ruby/test_utf32.rb, test/ruby/test_regexp.rb: add tests. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16759 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gb18030.c (gb18030_code_to_mbc): add 0x80000000naruse2008-06-011-0/+3
| | | | | | for 4bytes character. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16739 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gb18030.c (gb18030_mbc_to_code): mask by 0x7FFFFFFFnaruse2008-06-011-1/+14
| | | | | | | | because OnigCodePoint will be used as 32bit signed int. Masking by 0x7FFFFFFF is ok on GB18030; Minumum 4bytes character is 0x81308130. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16737 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_16{be,le}.c (utf16{be,le}_code_to_mbc):naruse2008-05-312-17/+12
| | | | | | fix codepoint to bytes. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16717 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * common.mk (prelude.c): simply depends on PREP. [ruby-dev:34877]nobu2008-05-302-16/+4
| | | | | | | * enc/make_encdb.rb, enc/trans/make_transdb.rb: ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16703 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_8.c: add UTF8-MAC (UTF-8-MAC).naruse2008-05-291-0/+10
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16697 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/japanese.c (to_SHIFT_JIS_EF_infos): typo.usa2008-05-281-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16661 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/japanese.c: add workarround for Unicode to CP932.naruse2008-05-281-15/+36
| | | | | | | U+2015->0x815C, U+2225->0x8161, U+FF0D->0x817C, U+FF3C->0x815F, U+FF5E->0x8160, U+FFE0->0x8191, U+FFE1->0x8192, U+FFE2->0x81CA git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16657 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/utf_16_32.c (fun_so_to_utf_16be, fun_so_to_utf_16le): addmame2008-04-171-3/+3
| | | | | | | | | | | | | | | | | parentheses to remove warnings of gcc. * io.c (rb_io_getc): remove unused variables. * compile.c (NODE_NEXT, NODE_REDO): remove unused labels. * ext/nkf/nkf.c (rb_nkf_convert): remove unused variables. * ext/syck/rubyext.c (syck_resolver_initialize, syck_resolver_detect_implicit, syck_emitter_emit): remove unused variables. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@16061 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * common.mk (prelude.c): depends on enc/prelude.rb.nobu2008-04-081-1/+1
| | | | | | | * enc/prelude.rb: fixed initial library names. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15922 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * encoding.c (enc_init_db): moved to enc/encdb.c.nobu2008-04-074-0/+52
| | | | | | | | | | | | * transcode.c (init_transcoder_table): moved to enc/trans/transdb.c. * enc/depend (enc/encdb.o enc/trans/transdb.o): depend on corresponding headers. * common.mk (COMMONOBJS): moved transcode.o from OBJS git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15915 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Sun Mar 16 18:07:07 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-03-161-15/+15
| | | | | | | | | | | * enc/trans/utf_16_32.c: bug fix (some invalid UTF-8 sequences were legal) * test/ruby/test_transcode.rb: test for above bug git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15786 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * ext/extmk.rb, enc/make_encmake.rb: load current mkmf.rb even ifnobu2008-02-261-2/+2
| | | | | | | | | | cross-compiling. * ext/extmk.rb, enc/make_encmake.rb, lib/mkmf.rb: need to be 1.8 compatible for cross-compiling. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15616 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/{depend,make_encdb.rb,trans/make_transdb.rb}: sort in alpha-numeric order.nobu2008-02-223-3/+7
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15567 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/{euc_jp.c,gbk.c,iso_8859_1.c,iso_8859_11.c,iso_8859_13.c,naruse2008-02-1713-4/+337
| | | | | | | | | | iso_8859_2.c,iso_8859_6.c,iso_8859_7.c,iso_8859_8.c,iso_8859_9.c, shift_jis.c,windows_1251.c}: add document about encodings. * enc/cp949.c: divided into new file. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15516 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/iso_8859_{4,13}.c: Windows-1257 is replica of ISO-8859-13.naruse2008-02-152-2/+9
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15495 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * lib/uri/generic.rb: revert r15442. 2nd argument of String#sub parsenaruse2008-02-131-2/+2
| | | | | | | | | escapes. [ruby-dev:33726] * bootstraptest/test_method.rb enc/depend instruby.rb lib/mkmf.rb mkconfig.rb: revert r15443. ditto. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15456 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/depend: fix typo.usa2008-02-131-1/+1
| | | | | | | | | * lib/mkmf.rb: revert r15443. "\\1#{sep}\\2" is wrong if sep is ended with "\\". git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15455 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * bootstraptest/runner.rb, bootstraptest/test_method.rb, enc/depend,naruse2008-02-121-2/+2
| | | | | | | | instruby.rb, lib/mkmf.rb, lib/test/unit/util/procwrapper.rb, mkconfig.rb, sample/test.rb, template/vm.inc.tmpl, test/ruby/test_stringchar.rb: fixes arround String#gsub. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15443 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/korean.c: add support for CP949 by Park Ji-In. [ruby-dev:33626]naruse2008-02-071-6850/+34924
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15393 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/korean.c: add EUC-KR conversion support by Park Ji-In.naruse2008-02-061-0/+17938
| | | | | | [ruby-dev:33621] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15385 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/*.c: add GB12345, UCS-{2,4}{BE,LE}.naruse2008-01-305-0/+7
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15341 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_16be.c (UTF16_IS_SURROGATE_FIRST): avoid branch.akr2008-01-302-7/+43
| | | | | | | | | | | | | | (UTF16_IS_SURROGATE_SECOND): ditto. (UTF16_IS_SURROGATE): defined. (utf16be_mbc_enc_len): validation implemented. * enc/utf_16le.c (UTF16_IS_SURROGATE_FIRST): avoid branch. (UTF16_IS_SURROGATE_SECOND): ditto. (UTF16_IS_SURROGATE): defined. (utf16le_mbc_enc_len): validation implemented. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15338 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* fix state definition.akr2008-01-291-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15333 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_tw.c (euctw_mbc_enc_len): validation implemented.akr2008-01-291-2/+97
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15331 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_tw.c (euctw_islead): 0x8e is a leading byte.akr2008-01-291-1/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15323 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/make_transdb.rb: add for make transdb.h.naruse2008-01-291-12/+35
| | | | | | | | | | * dmytranscode.c: add for miniruby. * enc/gbk.c (gbk_left_adjust_char_head, gbk_is_allowed_reverse_match): fix odd regexp match. [ruby-dev:33502] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15321 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * add enc/trans/make_transdb.rb, dmytranscode.cnaruse2008-01-291-0/+40
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15320 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/japanese.c (rb_to_Windows_31J): to 'Windows-31J'.naruse2008-01-291-1/+1
| | | | | | | | | * common.mk: add rules for transdb.h. * transcode.c (init_transcoder_table): use transdb.h. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15317 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gbk.c (EncLen_gbk): too short. [ruby-dev:33497]naruse2008-01-291-0/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15315 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gb18030.c (gb18030_mbc_enc_len): validation implemented.akr2008-01-291-9/+97
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15313 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_kr.c: remove CP949.naruse2008-01-293-13/+12
| | | | | | | | | * enc/euc_cn.c: remove CP936 and rename to gb2312.c * enc/gb2312.c: GB2312 is preferred MIME name. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15309 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gbk.c: add GBK, CP936 and CP949.naruse2008-01-292-3/+2
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15308 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/gbk.c: add GBK, CP936 and CP949.naruse2008-01-291-0/+192
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15307 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_7.h: add dummy encoding UTF-7 and its alias CP65000.naruse2008-01-281-0/+5
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15291 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/utf_8.c: add alias CP65001.usa2008-01-281-0/+1
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15290 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/big5.c (big5_mbc_enc_len): validation implemented.akr2008-01-281-2/+55
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15289 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/euc_kr.c (euckr_mbc_enc_len): validation implemented.akr2008-01-281-2/+55
| | | | git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15288 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * enc/trans/japanese.c (rb_from_Windows_31J, rb_to_Windows_31J):nobu2008-01-231-0/+12
| | | | | | | provisional workaround for Windows-31J. [ruby-dev:33320] git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15188 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Tue Jan 22 17:52:52 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-01-221-24/+24
| | | | | | | | | * enc/trans/utf_16_32.c: Streamline parentheses, add more 'static' qualifiers. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15169 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* Mon Jan 21 19:42:42 2008 Martin Duerst <duerst@it.aoyama.ac.jp>duerst2008-01-211-60/+384
| | | | | | | | | * transcode.c, enc/trans/utf_16_32.c, test/ruby/test_transcode.rb: added UTF-32BE and UTF-32LE conversions. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15156 b2dd03c8-39d4-4d8f-98ff-823fe69b080e
* * transcode.c (transcode_loop, str_transcoding_resize): use unsignednobu2008-01-212-28/+28
| | | | | | | | | | | | | | char. [ruby-dev:33232] * transcode_data.h (rb_transcoding, rb_transcoder): removed callback parameters. * enc/trans/japanese.c: ditto. * enc/trans/utf_16_32.c: parenthesized bit-or operands. git-svn-id: svn+ssh://ci.ruby-lang.org/ruby/trunk@15150 b2dd03c8-39d4-4d8f-98ff-823fe69b080e