php中文分词源码遇到的小问题
define('_SP_', chr(0xFF).chr(0xFE)); define('UCS2', 'ucs-2be');
这2个常量定义的作用是什么?_SP_定义成chr(0xFF).chr(0xFE)是什么意思,我在ascii对照表内根本找不到FF,FE这2个对应的编码啊?
后面的代码如下
//载入副词典 $hw = ''; $ds = file($dicAddon);//17行的txt格式字典文件 foreach($ds as $d) { $d = trim($d); if($d=='') continue; $estr = substr($d, 1, 1); if( $estr==':' ) { $hw = substr($d, 0, 1); } else { $spstr = _SP_; $spstr = iconv(UCS2, 'utf-8', $spstr);//怎么会出现ucs2编码?咋回事 $ws = explode(',', $d);//每一行的汉字,用中间的逗号分成数组 $wall = iconv('utf-8', UCS2, join($spstr, $ws));//用_SP_又组合成了字符串??,然后又转换成了ucs2? $ws = explode(_SP_, $wall);//又接着分割成数组?啥意思啊!!! foreach($ws as $estr) { $this->addonDic[$hw][$estr] = strlen($estr); } } }
这段代码,就是载入字典文件,可是我没明白ELSE代码的逻辑?谁能简单说说
回复讨论(解决方案)
你的字典文件是 ucs-2be 编码的
chr(0xFF).chr(0xFE) 是 ucs-2be 的 BOM
你的字典文件是 ucs-2be 编码的
chr(0xFF).chr(0xFE) 是 ucs-2be 的 BOM
还是有些不懂,建立_SP_这个常量有什么作用啊?ucs-2be的BOM直接写出来存入一个变量就行了,为什么还要拿chr()函数计算出来?
chr(0xFF).chr(0xFE) 可写作 “\xff\xfe"
不过作者没有你那么聪明,所以就用字符串函数写了
chr(0xFF).chr(0xFE) 可写作 “\xff\xfe"
不过作者没有你那么聪明,所以就用字符串函数写了
作者是dede的作者,怎么可能?kending bushi zheyangde
不是他,就是你
不知道变通!
不是他,就是你
不知道变通!
版主,我真没弄懂,人家用_SP_当字符串分割标识的,不是BOM吧,能帮帮忙嘛!
BOM 是编码类型声明,把 _SP_ 解释为 BOM 是为了帮助理解
你不是”在ascii对照表内根本找不到FF,FE这2个对应的编码“
再看
define('_SP_', chr(0xFF).chr(0xFE)); define('UCS2', 'ucs-2be');$spstr = _SP_;$spstr = iconv(UCS2, 'utf-8', $spstr);echo bin2hex($spstr);
这是 utf-8 的 BOM
至于他为什么要这样做,你看看字典文件就知道是怎么回事了
BOM 是编码类型声明,把 _SP_ 解释为 BOM 是为了帮助理解
你不是”在ascii对照表内根本找不到FF,FE这2个对应的编码“
再看
define('_SP_', chr(0xFF).chr(0xFE)); define('UCS2', 'ucs-2be');$spstr = _SP_;$spstr = iconv(UCS2, 'utf-8', $spstr);echo bin2hex($spstr);
这是 utf-8 的 BOM
至于他为什么要这样做,你看看字典文件就知道是怎么回事了
你说的好像不对,但是也没人知道

Hot AI Tools

Undresser.AI Undress
AI-powered app for creating realistic nude photos

AI Clothes Remover
Online AI tool for removing clothes from photos.

Undress AI Tool
Undress images for free

Clothoff.io
AI clothes remover

Video Face Swap
Swap faces in any video effortlessly with our completely free AI face swap tool!

Hot Article

Hot Tools

Notepad++7.3.1
Easy-to-use and free code editor

SublimeText3 Chinese version
Chinese version, very easy to use

Zend Studio 13.0.1
Powerful PHP integrated development environment

Dreamweaver CS6
Visual web development tools

SublimeText3 Mac version
God-level code editing software (SublimeText3)

Hot Topics











Session hijacking can be achieved through the following steps: 1. Obtain the session ID, 2. Use the session ID, 3. Keep the session active. The methods to prevent session hijacking in PHP include: 1. Use the session_regenerate_id() function to regenerate the session ID, 2. Store session data through the database, 3. Ensure that all session data is transmitted through HTTPS.

There are four main error types in PHP: 1.Notice: the slightest, will not interrupt the program, such as accessing undefined variables; 2. Warning: serious than Notice, will not terminate the program, such as containing no files; 3. FatalError: the most serious, will terminate the program, such as calling no function; 4. ParseError: syntax error, will prevent the program from being executed, such as forgetting to add the end tag.

PHP and Python each have their own advantages, and choose according to project requirements. 1.PHP is suitable for web development, especially for rapid development and maintenance of websites. 2. Python is suitable for data science, machine learning and artificial intelligence, with concise syntax and suitable for beginners.

In PHP, password_hash and password_verify functions should be used to implement secure password hashing, and MD5 or SHA1 should not be used. 1) password_hash generates a hash containing salt values to enhance security. 2) Password_verify verify password and ensure security by comparing hash values. 3) MD5 and SHA1 are vulnerable and lack salt values, and are not suitable for modern password security.

HTTP request methods include GET, POST, PUT and DELETE, which are used to obtain, submit, update and delete resources respectively. 1. The GET method is used to obtain resources and is suitable for read operations. 2. The POST method is used to submit data and is often used to create new resources. 3. The PUT method is used to update resources and is suitable for complete updates. 4. The DELETE method is used to delete resources and is suitable for deletion operations.

PHP is a scripting language widely used on the server side, especially suitable for web development. 1.PHP can embed HTML, process HTTP requests and responses, and supports a variety of databases. 2.PHP is used to generate dynamic web content, process form data, access databases, etc., with strong community support and open source resources. 3. PHP is an interpreted language, and the execution process includes lexical analysis, grammatical analysis, compilation and execution. 4.PHP can be combined with MySQL for advanced applications such as user registration systems. 5. When debugging PHP, you can use functions such as error_reporting() and var_dump(). 6. Optimize PHP code to use caching mechanisms, optimize database queries and use built-in functions. 7

The arrow function was introduced in PHP7.4 and is a simplified form of short closures. 1) They are defined using the => operator, omitting function and use keywords. 2) The arrow function automatically captures the current scope variable without the use keyword. 3) They are often used in callback functions and short calculations to improve code simplicity and readability.

PHP is widely used in e-commerce, content management systems and API development. 1) E-commerce: used for shopping cart function and payment processing. 2) Content management system: used for dynamic content generation and user management. 3) API development: used for RESTful API development and API security. Through performance optimization and best practices, the efficiency and maintainability of PHP applications are improved.
