29 commits

Author	SHA1	Message	Date
Edwin Cheng	a6d51e0961	Return Result for token_tree_to_xx functions	2019-04-19 04:03:22 +08:00
Edwin Cheng	c0f19d7005	Add expr, pat, ty and macro_stmts	2019-04-19 03:49:56 +08:00
Edwin Cheng	3ff5440a50	Add MacroItems and MacroStmts in grammer.ron	2019-04-19 02:47:29 +08:00
Edwin Cheng	f66300ccd1	Remove skip Delimiter::None and handle Dollars	2019-04-13 01:50:05 +08:00
Edwin Cheng	2697ecaa64	Use SubtreeWalker instread of flatten TtToken	2019-04-08 15:58:02 +08:00
Edwin Cheng	a7254201df	Combine all tokensource to one and refactoring	2019-04-08 00:12:07 +08:00
Edwin Cheng	7f1e93a3c9	Refactoring subtree_source	2019-04-07 21:42:53 +08:00
Edwin Cheng	aac9dfa464	Add TtCursorTokenSource and TtCursorTokenSink	2019-04-06 20:14:28 +08:00
Edwin Cheng	7abc06bd57	Add proper test for literals and fixed typo bug	2019-04-05 20:58:24 +08:00
Edwin Cheng	1ea0238e53	Add classify_literal and undo expose next_token	2019-04-05 18:45:19 +08:00
Edwin Cheng	1ab78d6056	Fix literal support in token tree to ast item list	2019-04-05 18:23:01 +08:00
Edwin Cheng	6ff16c7ad9	Clean up	2019-04-05 03:54:18 +08:00
Edwin Cheng	c23408751c	Add multi-byte token support in tkn tree to ast	2019-04-05 03:39:54 +08:00
Aleksey Kladov	9e213385c9	switch to new rowan	2019-04-01 12:06:24 +03:00
Dale Wijnand	ffca2c1fe4	Fix a typo	2019-02-26 17:59:32 +00:00
Aleksey Kladov	81bca78349	rename	2019-02-24 13:14:14 +03:00
Aleksey Kladov	8cf156d85b	Add a test for macro parsing	2019-02-23 17:51:23 +03:00
Aleksey Kladov	8eac450f41	implement tt -> ast	2019-02-23 17:21:56 +03:00
Aleksey Kladov	83d6be6cec	keep-text	2019-02-23 16:55:18 +03:00
Aleksey Kladov	71b8a874e7	flatten tt	2019-02-23 16:55:18 +03:00
Aleksey Kladov	10deefd371	token source scaffold	2019-02-23 16:55:18 +03:00
Aleksey Kladov	60373aa504	add interface	2019-02-23 16:55:18 +03:00
Aleksey Kladov	ae312680d6	docs	2019-02-11 21:31:54 +03:00
Aleksey Kladov	0d34a256de	assign ids when converting tt	2019-02-11 21:12:06 +03:00
Aleksey Kladov	58897dd8dd	assign ids to tokens	2019-02-11 21:02:19 +03:00
Aleksey Kladov	12e3b4c70b	reformat the world	2019-02-08 14:49:43 +03:00
Aleksey Kladov	b4b522fb39	cleanup the api	2019-01-31 22:23:30 +02:00
Aleksey Kladov	a16f6bb27d	cleanup	2019-01-31 22:23:30 +02:00
Aleksey Kladov	2d1f0b105d	move test	2019-01-31 22:23:30 +02:00