50 commits

Author	SHA1	Message	Date
Alan Du	40424d4222	Fix clippy::identity_conversion	2019-06-04 18:05:07 -04:00
Alan Du	619a615298	Fix clippy::len_zero	2019-06-04 18:05:07 -04:00
Edwin Cheng	54ea251bd4	Store referece in tokenbuffer	2019-06-03 00:54:33 +08:00
Aleksey Kladov	61e1474ab3	fix typos in mbe tests	2019-05-28 18:46:11 +03:00
Aleksey Kladov	1cece9f219	return errors from tree builder	2019-05-28 16:26:14 +03:00
Edwin Cheng	a3b9aecc9b	Minor use module	2019-05-28 00:54:32 +08:00
Edwin Cheng	98aac6b751	Simpliy how collecting token from src	2019-05-28 00:38:55 +08:00
Edwin Cheng	d833ded3b4	Remove Queier and SubtreeWalk	2019-05-27 23:20:43 +08:00
Edwin Cheng	90764fc54b	Remove duplicated code	2019-05-26 02:41:00 +08:00
Edwin Cheng	816147c4b5	Simplify token_tree_to_xxx	2019-05-25 21:55:46 +08:00
Edwin Cheng	fcb1eef323	Change TokenSource to iteration based	2019-05-25 20:41:03 +08:00
Edwin Cheng	dd50ca7c5e	Refactor SubtreeSource	2019-05-23 02:23:56 +08:00
Sergey Parilin	993abedd77	apply T! macro where it is possible	2019-05-15 15:35:47 +03:00
Edwin Cheng	10ecb11ff5	Error out non single root token tree conversion	2019-05-14 07:59:28 +08:00
Edwin Cheng	036141663b	Quote the quoted comment	2019-05-04 19:34:02 +08:00
Edwin Cheng	048f12d9f0	Use explict escape_default instead of dbg print	2019-05-04 17:03:22 +08:00
Edwin Cheng	e7e896170a	Convert doc comment to attr	2019-05-04 15:00:16 +08:00
Edwin Cheng	6b2985ebc7	Remove unused code and add space bewteen tt	2019-05-02 10:02:17 +08:00
Edwin Cheng	c55a2dbc1d	Fix more bugs	2019-04-26 02:03:56 +08:00
Edwin Cheng	299d97b6d9	Add handling token seperator in mbe	2019-04-26 02:03:55 +08:00
Edwin Cheng	313854c728	Add lifetime matcher	2019-04-19 21:15:19 +08:00
Edwin Cheng	a6d51e0961	Return Result for token_tree_to_xx functions	2019-04-19 04:03:22 +08:00
Edwin Cheng	c0f19d7005	Add expr, pat, ty and macro_stmts	2019-04-19 03:49:56 +08:00
Edwin Cheng	3ff5440a50	Add MacroItems and MacroStmts in grammer.ron	2019-04-19 02:47:29 +08:00
Edwin Cheng	f66300ccd1	Remove skip Delimiter::None and handle Dollars	2019-04-13 01:50:05 +08:00
Edwin Cheng	2697ecaa64	Use SubtreeWalker instread of flatten TtToken	2019-04-08 15:58:02 +08:00
Edwin Cheng	a7254201df	Combine all tokensource to one and refactoring	2019-04-08 00:12:07 +08:00
Edwin Cheng	7f1e93a3c9	Refactoring subtree_source	2019-04-07 21:42:53 +08:00
Edwin Cheng	aac9dfa464	Add TtCursorTokenSource and TtCursorTokenSink	2019-04-06 20:14:28 +08:00
Edwin Cheng	7abc06bd57	Add proper test for literals and fixed typo bug	2019-04-05 20:58:24 +08:00
Edwin Cheng	1ea0238e53	Add classify_literal and undo expose next_token	2019-04-05 18:45:19 +08:00
Edwin Cheng	1ab78d6056	Fix literal support in token tree to ast item list	2019-04-05 18:23:01 +08:00
Edwin Cheng	6ff16c7ad9	Clean up	2019-04-05 03:54:18 +08:00
Edwin Cheng	c23408751c	Add multi-byte token support in tkn tree to ast	2019-04-05 03:39:54 +08:00
Aleksey Kladov	9e213385c9	switch to new rowan	2019-04-01 12:06:24 +03:00
Dale Wijnand	ffca2c1fe4	Fix a typo	2019-02-26 17:59:32 +00:00
Aleksey Kladov	81bca78349	rename	2019-02-24 13:14:14 +03:00
Aleksey Kladov	8cf156d85b	Add a test for macro parsing	2019-02-23 17:51:23 +03:00
Aleksey Kladov	8eac450f41	implement tt -> ast	2019-02-23 17:21:56 +03:00
Aleksey Kladov	83d6be6cec	keep-text	2019-02-23 16:55:18 +03:00
Aleksey Kladov	71b8a874e7	flatten tt	2019-02-23 16:55:18 +03:00
Aleksey Kladov	10deefd371	token source scaffold	2019-02-23 16:55:18 +03:00
Aleksey Kladov	60373aa504	add interface	2019-02-23 16:55:18 +03:00
Aleksey Kladov	ae312680d6	docs	2019-02-11 21:31:54 +03:00
Aleksey Kladov	0d34a256de	assign ids when converting tt	2019-02-11 21:12:06 +03:00
Aleksey Kladov	58897dd8dd	assign ids to tokens	2019-02-11 21:02:19 +03:00
Aleksey Kladov	12e3b4c70b	reformat the world	2019-02-08 14:49:43 +03:00
Aleksey Kladov	b4b522fb39	cleanup the api	2019-01-31 22:23:30 +02:00
Aleksey Kladov	a16f6bb27d	cleanup	2019-01-31 22:23:30 +02:00
Aleksey Kladov	2d1f0b105d	move test	2019-01-31 22:23:30 +02:00